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Message from Moscow 


first International Congress of Automatic Control 

was held in Moscow at the Moscow State Uni- 
versity. There were about 1100 delegates from all over 
the world, and they came to hear 285 papers concern- 
ing control theory, applications, and components as 
well as to visit various industries and institutes and to 
meet the Russian scientists and the Russian people. 

At the first session of the Congress, we were made 
aware of the great importance that the Soviet Union is 
placing on automation and automatic control. The 
Congress was regarded as a national event. A special 
postage stamp had been issued to commemorate the 
event, and Vice Premier A. N. Kosigin, First Vice 
President of the Council of Ministers of the USSR, wel- 
comed the delegates at the opening session. Later, all 
delegates and their wives were given engraved invita- 
tions to a reception at the Kremlin Palace, a rare event 
and a special honor. 

The principal address at the opening session of the 
Congress was entitled “Automation and Mankind” and 
it was presented by Academician V. A. Trapeznikov. 
It followed welcoming speeches by IFAC President, 
Professor A. M. Letov of the USSR, by past president 
Harold Chestnut of the USA, and others. Professor 
Trapeznikov’s talk was widely acclaimed by all the dele- 
gates for its sober, yet inspiring survey of the future of 
automatic control, of the challenging problems that 
confront us, and of the progress that has been made in 
Russia and in the Western countries. Professor Trapez- 
nikov was evidently stating the Soviet attitude toward 
automatic control and the direction it will take when he 
said, “The goals of automation can only be achieved 


[i mid-summer of 1960, from June 27 to July 7, the 


_when all steps of the industrial processes have been 


automated in all basic industries . . . when comprehen- 
sive automation has been realized to cover ramified re- 
mote control systems widely using computers. . . not 
only will automation raise productivity, but it will also 
radically change the very nature of labor.... The 
full utilization of the benefits arising out of automation, 
however, is only possible in a rationally organized soci- 
ety where the manpower made redundant due to auto- 
mation in one field is easily absorbed in others. Our firm 
conviction—which we do not, of course, impose on any- 
body—is that this possibility is offered by the socialist 


_ system. 


« | . With increasingly more material benefits avail- 


able due to automation, a smaller proportion of people 
will be needed in production.... With more leisure 


mS time,... 


man will be able—for the first time in history 


-—+to devote to himself the attention he rightly de- 


serves. . 


Cor 


. . The goal of automation is a noble one. It is 
realistic and feasible. But there are a number of obsta- 
cles to clear and a number of formidable problems to 


_ solve before it can be achieved,” 


7 a ae . — 


In detail, Professor Trapeznikov outlined the various 
problems that confront us in the areas of optimal con- 
trol, adaptive control, and logic machines to supplement 
human designers. He noted that “advances in engineer- 
ing and science are laying a single theoretical foundation 
for the whole range of engineering subjects involved in 
communication and control. ... This comprehensive 
theory—still in the making—is often called either com- 
munication and control theory, control: theory, or en- 
gineering cybernetics. However, the name is not essen- 
tial. What is important is the crystallization of funda- 
mental ideas, principles, and methods. The development 
of this single theory is vital to automation. 

“No progress of automatic control theory and en- 
gineering, however, is possible without commensurate 
advances in automation hardware. It has always been 
that every new device... has given use to quantitative 
changes, to further headway of automatic control 
theory. 

“In the field of automation hardware, there are... 
problems which are still waiting for their solution.” Pro- 
fessor Trapeznikov emphasized the particular problems 
of reliability, of obtaining unitized control systems, and 
microminiaturization or molecular engineering where he 
said, “... The progress made in this field is particu- 
larly striking in the Western countries.” 

Finally, he mentioned the well-known problems of sci- 
entific effort and research: “... the optimal decision 
problem as applied to the planning of research and en- 
gineering does not and cannot have a hard and fast solu- 
tion... . It is absolutely clear that the role of funda- 
mental research is bound to grow with time, and its 
scope should be extended. This is the prerequisite for the 
true progress of science and engineering. On the other 
hand, the wider the scope... the more difficult it is to 
organize it. How can we possibly exclude cases when the 
investigator takes a byroad for the highway only to 
find himself in a blind alley? How can we possibly reduce 
the drain of effort and time involved in trials and errors 
in a multitude of unknown domains? 

... “The prospects of progress before humanity are 
imposing and advances in automation and control the- 
ory are part of the general progress. ... Peace is the 
vital prerequisite for the prosperity of man, for the de- 
velopment of science, for the progress of automation.” 

This talk was a small but significant part of the mes- 
sage that we bring from Moscow. It was more than a 
learned survey of the control field and its problems— 
it was a challenge to control engineers to strive toward 
realization of the promise that is inherent in automatic 
control. In particular, it was a challenge to the countries 
of the Western world because it implied that complete 
industrial automation, and the high standard of living 
it can create, could not be achieved effectively by any 
but a socialist form of government. From our direct ob- 
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servations, it was apparent that the Soviet Union has 
far to go before it will approach the level of automation 
that exists in the United States, but it is evident that 
an accelerated and sincere effort is being made to ac- 
complish their goal of achieving universal automation. 
In Kiev, for example, a new institute has been built ex- 
pressly for the purpose of automating all branches of 
industry. By 1965, it is expected that the institute will 
have over 6000 engineers working toward this goal, and 
that there will be several other automatic control insti- 
tutes in different parts of Russia working intensely, 
blending theory and practice toward their common goal. 
If this trend continues successfully, it will be an effort 
unsurpassed by any nation. With the full support of the 
government and with the large number of graduate en- 
gineers entering the control field each year, the evolu- 
tion of Russian industry and production could be ex- 
ceedingly swift. 

From the papers and discussions that we heard, from 
the people that we met, from the industries and insti- 
tutes that we visited, and from meetings with other dele- 
gates, several specific conclusions were reached: 

1) The Russians have devoted a greater effort than 
the United States in developing automatic control the- 
ory, and in the future they will contribute far more 
money and manpower to this field which they regard as 
a major science. 

2) The Russians are more aware of what we are doing 
in automatic control than we are of what they are doing 
largely because of their translation methods and their 
system of distributing this literature. Yet, it appears 
that their own effort is somewhat hampered by their 
necessary affiliation with the government and the vari- 
ous overlapping functions of many technological insti- 
tutes. They have exceptional talent and leadership in 
the control field, but it appears that it is not yet eff- 
ciently organized. 

3) The Russians have been leaders for many years 
in the theory of automatic control, yet it seems that 
they lag in its application, at least in western Russia. 
There is also evidence that their progress in developing 
the theory has been impeded by the fact that it is too 
mathematical; by not being applied, the practical limi- 
' tations of the theory are not evident, new problems do 
not present themselves and the basic engineering need 
for control becomes lost. However, the Russians appear 
to realize this, and to instill new life in their control pro- 
gram, they are developing a huge nationwide plan for 
automating all industries with the leadership of engi- 
neers and scientists in new control institutes. 

4) To compete with the Russian effort with less man- 
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power and with fewer facilities, we must concentrate on 
developing basic control theory as derived from actual 
engineering problems rather than devoting the largest 
portion of our over-all effort to mathematical manipula- 
tion of hypothetical but elegant system equations. Of 
course, it will be necessary to use and develop new math- 
ematical methods to obtain this theory, but mathe- 
matics should be the means and not the end to the de- 
velopment of new engineering knowledge. 

There is more to our message from Moscow: 

We were visitors in a land with a language, a culture, 
and a heritage far different from our own. We met the 
people there, and, in general, found them to be courte- 
ous, helpful, and pleasant. Some delegates thought that 
there were people who were rather grim and unhappy, 
but it was not a predominant mood because many of 
them, especially the younger generation, seemed to be 
enjoying the new freedoms that have been recently 
granted to them. In fact, it seemed that they carried 
the problems of the world more calmly than we do, and 
they may be less influenced by Soviet proclamations 
than we are. Of course, they have few of the luxuries that 
we regard as necessities, but they do have more than 
they ever had. They have had the promise, now the be- 
ginning of hope that their future will be brighter, that 
one day they may attain and even surpass our standard 
of living. 

Our stay in Russia was limited, our activities were 
numerous but brief, and our experiences were memor- 
able but veiled with the swift passage of time. Thus, 
with the specific parts of our message from Moscow 
there are others less vivid but essential to our over-all 
impression. Activities, experiences, impressions, memo- 
ries merge and swirl in a vision: we had glanced behind 
the iron curtain through a door labeled automatic con- 
trol. Before us stretched a long corridor paved with 
mathematical symbols and bordered on either side with 
high reddish walls, towered and crenelated, dusty and 
inlaid with glittering relics of a turbulent past. Glim- 
mering torches aligned these ominous walls casting a 
friendly glow that stretched away in the distance. Far 
along the way, behind a translucent panel, there was a 
bustle of activity. We were near enough to see shadowy 
figures moving behind the panel and to hear the babble 
of voices and the whirring sound of invisible machinery. 
In the diffuse light we could not divine its purpose— 
perhaps it was an illusion—but overhead, above the 
ancient walls, we could see the dark sky, and from be- 
hind the distant panel portentous lights were rising 
among the stars. 


—The Editor 
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PGAC Chairman’s Message” 


JOHN M. SALZER}, sENIOR MEMBER, IRE 


HE Professional Group on Automatic Control is 

coming into its own. The ardent work of many an 

individual both in the national and chapter or- 
ganizations has borne gratifying, if not remarkable, 
fruit over the past six years. We have come a long way 
over a rather short time, as many important achieve- 
ments can testify. 

Presently we count around 4000 members, eleven ac- 
tive chapters, a treasury balance of about $10,000 (in 
spite of our increased publication costs), we issue at 
least four TRANSACTIONS each year, and we send the 
Newsletter to all our members several times a year. 

The last year was studded with particularly im- 
portant milestones for PGAC. We participated in the 
operation of the American Automatic Control Council 
(AACC), which is a member of the International Fed- 
eration of Automatic Control (IFAC). The First Inter- 
national Congress was held by IFAC in Moscow during 
this period. A large number of the 140 American dele- 
gates participating in this conference were members of 
PGAC-IRE. In November, 1959, PGAC sponsored the 
First National Automatic Control Conference co-spon- 
sored by the other four societies (AIChE, AIEE, ASME, 
ISA) represented in AACC. Under the Chairmanship 


of Louis B. Wadel, now our PGAC Vice Chairman, the 


Dallas Conference proved to be a tremendous success 
_and set the stage for the Annual Joint Automatic Con- 
trol Conferences. The first of the latter was held in 
September, 1959, in Cambridge, Massachusetts, under 
the sponsorship of ASME with appropriate PGAC 


* Received by the PGAC, November 17, 1960. Ze 
+ Director, Intellectronics Labs., Thompson Ramo Wooldridge, 
Inc.; Canoga Park, Calif. 
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participation. In the past year, we made two recom- 
mendations for IRE awards and one recommendation 
for a Fellow award. We have also established a new an- 
nual award of $100 for the best paper published in the 
PGAC TRANSACTIONS. For these achievements and for 
this general progress, PGAC is indebted to all those 
who helped. The officers and all active members of 
every chapter, as well as those of us who work on the 
national committees, had a part in these accomplish- 
ments, and we all are thankful for the devoted service 
of our past Chairman, John E. Ward, who worked with 
us for two years in this capacity and did so with untiring 
effort. 

We cannot rest on the merits of past accomplishments 
and on the false assurance that things will take care of 
themselves. We must continue and strengthen our pres- 
ent activities. We are supporting ISA in the preparation 
for the next Joint Automatic Control Conference. We 
continue to be active participants in AACC. We will 
make proposals for awards and publicize these oppor- 
tunities to all our members. We will provide more help 
to the chapters in advice and coordination from the 
National Chapters Committee, and we expect to estab- 
lish additional chapters and launch a national member- 
ship drive. We will both increase our publications and 
become more selective in accepting papers. We will con- 
tinue to sponsor PGAC sessions at the national IRE 
meetings. We will establish a committee to examine the 
basic objectives and scope of operation of PGAC and 
suggest some modification or expansion if appropriate. 

These are some of our aims and these are some of the 
tasks we foresee. All of us will have a part in this pro- 
gram. As your new Chairman, I will try to serve you 
with diligence and dedication. 
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The Issue in Brief 


Of the ten papers featured in this issue, half of them are devoted 
to theoretical optimization of control systems and the rest pertain to 
application of theory and physical control problems. 


An Optimal Strategy for a Saturating Sampled-Data System, C. A. 
Desoer and J. Wing 


A usual second-order sampled-data system is considered with a 
zero-order hold, but the forcing function applied to the plant may 
not be larger than unity in absolute value. The problem discussed is 
that of determining an optimum strategy, a forcing function which 
forces the plant from an arbitrary initial state of equilibrium in the 
least number of sampling periods. 


Time Optimal Control of Higher-Order Systems, F. B. Smith, Jr. 


Phase space has been considered as the basis for synthesizing op- 
timum control for high-order systems, but the mathematical surfaces 
are difficult to represent physically and this has been considered a 
handicap. However, this paper considers the determination of an 
optimum forcing function from the state variables of the system 
without considering phase space. The theory is developed, an example 
is given, and a brief discussion follows. 


Control System Performance Measures: Past, Present, and Future, 
W. C. Schultz and V. C. Rideout 


This is essentially a review and tutorial paper which explains the 
development, the use, and the future of expressions which have been 
proposed to define system performance. The importance of this per- 
formance index in the design of adaptive systems is stressed and an 
extensive bibliography is included. 


A Simulator Study of a Two-Parameter Adaptive System, R. J. 
McGrath and V. C. Rideout 


A sinusoidal perturbation is used to determine the optimum per- 
formance of a system, and one of the performance indexes discussed in 
the previous paper gives an indication when the performance deviates 
from optimum. Two parameters are changed or adapted automati- 
cally to changing conditions, and it is shown that the system will 
adapt itself to an optimum condition when sinusoidal or random in- 
puts are applied to it. 


Optimum Prediction with a Mean Weighted Square Error Criterion, 
C. C. Glover 


This paper is an example of the trend for future emphasis on ap- 
plications of statistical concepts and general integral forms to system 
optimization that is discussed by W. C. Schultz and V. C. Rideout in 
another paper in this issue. This theory of optimum prediction is de- 
veloped and an example is given. 


Control Systems with Minimum Spectral Bandwidth of Plant Input, 
J. C. Hung 


It is desirable to attenuate high-frequency components of signals 
which are applied to the plant of a control system to prevent excita- 
tion of inherent resonant poles. It is shown in this paper that mini- 


mizing a closed-loop system bandwidth for minimum error does not 
necessarily minimize the plant input spectrum and the resonant poles 
may be excited. The conditions which limit the system bandwidth 
and the plant input spectrum are discussed and an example is present. 


A Network Theory for Carrier-Suppressed Modulated Systems, 
G. Weiss 


Considerable literature has been written about carrier-suppressed 
modulated systems. Some of these previous developments are dis- 
cussed and unified in this presentation which considers analysis and 
synthesis of carrier-frequency networks using root-locus techniques 
and approximate methods. It is shown that approximation methods 
commonly used are theoretically sound over a relatively wide fre- 
quency range. 


Design Aspects of Attitude Control Systems, M. F. Marx 


This discussion is quite different in nature from those previously 
described. It concerns the practical problem involved in obtaining a 
desirable control of missile attitude. It is concluded that the control 
system must be basically different for various modes and regions of 
operation. It is suggested that it be adaptive during boost and re- 
covery and that it need not be optimum in the sense of satisfying any 
particular error criterion. 


Analysis and Design of Feedback System with Gain and Time Con- 
stant Variations, K. Chen 


The problem considered in the paper is encountered in many con- 
trol system designs. It is desired to determine the transient response 
of a control loop which has a variable gain and time constant. In this 
case, the stabilization problem is complicated by the fact that the 
gain and time constant may become negative and produce open-loop 
instability. Nevertheless, a method of designing the system to have 
a desired transient response is discussed in this paper. 


Evaluation of Transient Response Coefficients, D. S. Billingsley and 
M. G. Rekoff, Jr. 


A method of obtaining the transient response coefficients from a 
root-locus plot for roots of any multiplicity is described. 


Correspondence 


R. M. du Plessis has two contributions: one is a discussion of a 
previous PGAC paper by Dr. Braun and the other concerns the 
digital programming of multirate sampled-data systems. P. Dorato 
discusses short-time stability; and Professor Jury surveys various 
sampling methods in one contribution and, in another, co-authored by 
B. H. Bharaucha, he presents some notes on the stability criterion for 
linear discrete systems. 


Information on Translation of Russian Technical Journals 


It was noted at the JACC meeting in Boston that complete trans- 
lations of four Russian journals have been made for the past three 
years by the ISA and they are available, at low cost, to anyone. De- 
tails are given in this issue. 
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An Optimal Strategy for a Saturating 
Sampled-Data System* 


C. A. DESOER}, SENIOR MEMBER, IRE, AND J. WINGT, MEMBER, IRE 


Summary—Consider the usual sampled-data control system in 
which the sampler is followed by a zero-order hold and the transfer 
function is G(s)=1/s(s+a). Saturation is represented by the fact 
that the forcing function applied to G(s) may not be larger than 1 in 
absolute value. The problem is to determine a saturating zero-order 
hold forcing function which forces the system from an arbitrary initial 
state to equilibrium in the least number of sampling periods. Such a 
forcing function is defined as an optimal strategy. 

The state plane is divided into boundary states and interior 
states. To each boundary state corresponds a unique optimal strategy. 
To each interior state correspond infinitely many optimal strategies. 

From the system parameters a polygonal curve, called the critical 
curve, is defined in the state plane. An optimal strategy is then pro- 
posed in which the required forcing function is simply obtained by 
computing the distance of the representative point in state plane to 
the critical curve. A simple computer is proposed to implement this 
optimal strategy. Finally, the proposed optimal strategy is shown to 
reduce in the limit as T—0 to that of the corresponding continuous 
system. 


I. INTRODUCTION 


HE increasing use in control systems of digital 

data links, digital computers, and other intermit- 

tently operative devices has stimulated consider- 
able investigations in the field of sampled-data control 
systems. One important aspect of the sampled-data field 
that has been neglected is that problem which cor- 
responds to the optimal relay servo of the continuous 
control system [1]—[3]. The optimal relay servo problem 
is concerned with a system described by a linear dif- 
ferential equation with constant coefficients. The con- 
trol signal of the system f(t) is constrained between the 
saturation limits +1 and —1. The problem is then to 
determine that f(t) such that the system is forced to 
equilibrium in minimum time. 

The optimal control problem for continuous systems 
has resulted in considerable effort being expended in its 
* solution as is evident from the large amount of literature 
available on this subject. This paper extends some pre- 
liminary results of Kalman [4]. Here we will be con- 
cerned with a particular second-order linear servomech- 
anism. It will be shown in a rigorous manner that the 
optimal control signal for this system may be obtained 
by an extremely simple method using standard analog 
computer techniques [6]. 

The paper starts by presenting a formulation of the 
problem that requires the minimum number of param- 
eters. The set of all possible initial states is partitioned 


* Received by the PGAC, January 18, 1960; revised manuscript 
received, June 17, 1960. This research was supported by the U. S. 
Air Force through the Air Force Office of Scientific Research of the 
Air Res. and Dev. Command, under Contract No. AF 18(1600)-1521. 

+ Elec. Engrg. Dept., University of California, Berkeley, Calif. 


into sets Ry, in terms of the minimum number of sam- 
pling periods required to reach equilibrium. Theorems 
1—3 establish the exact shape of these sets. In Theorem 
4, it is shown that only for special initial states is the 
optimal strategy unique. In Section VI the optimality 
of the proposed strategy is established, followed by the 
implementation of the optimal strategy. Finally, the 
relationship between the optimal strategy for the 
sampled system and the optimal relay solution for the 
corresponding continuous system is discussed in detail. 


IJ. STATEMENT OF THE PROBLEM 


Fig. 1 shows the servomechanism that will be consid- 
ered throughout the paper. Note that the plant is de- 
scribed by a second-order transfer function G(s) 
=K/s(sta), (a>0), and that it is preceded by a 
saturating amplifier. Note also that the feedback loop 
consists of a computer whose input is c(t) and whose out- 
put is F(t). The problem is the following: Assuming that 
r(t) is zero for all times and given an arbitrary set of 
initial conditions c(0), ¢(0), find the forcing function 
F(t) and the corresponding computer which will bring 
the system to equilibrium in the minimum number of 
sampling periods. 


Saturating amplifier 


c(t) 


Fig. 1—Block diagram of the system under consideration. 


Let us first reduce the number of parameters by ap- 
propriate normalizations. By suitably selecting the unit 
of the forcing function F(¢) the saturation limits become 
+1 and —1. This normalization changes the gain con- 
stant K of G(s) to K’. By a suitable time normalization 
the new constant K’ of G(s) can be made equal to 
unity, since by expanding the time scale by a factor of 
k-1 we accomplish two things: 1) change s to sk, and 
2) multiply the transfer function by k. This simultane- 
ous forcing function and time normalization reduces the 
problem to a two-parameter problem: a, the time con- 
stant of the plant G(s) and 7, the sampling period. 
Therefore, the problem is reduced to that shown in Fig. 
2, where it is understood that the effective forcing func- 
tion f(t) must satisfy the following two constraints: 1) 
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Fig. 3—Typical forcing function f(t). 


at all times |f() | <1, a requirement which follows from 
the saturation, and 2) f(é) is a zero-order hold function; 
more precisely, for any interval kT <t<(k+1)T, 
(where k is an integer), the effective forcing function 
f(t) is constant. This requirement follows from the fact 
that the original system had a sampler with period T 
followed by a zero-order hold circuit. Fig. 3 shows a 
typical forcing function f(t). The effective forcing func- 
tion is completely defined by the sequence of numbers 
fi, fe, - + > , where fi is the value of f(¢) during the first 
sampling period 0<t<T, and, in general, f,=/(t) for 
(yi) WIE eB 2 Be Pee 

The problem can therefore be reformulated as follows: 
Given the system shown in Fig. 2 and given an arbi- 
tary set of initial conditions, c(0) and ¢(0), find an effec- 
tive forcing function f(t), specified by fi, fo, - - - , which 
will bring the system to equilibrium in the minimum 
number of sampling periods. 


III]. Matrix FORMULATION 
Fig. 2 and the constraints on the effective forcing 
function imply that, for0<t<7, 
c(t) + acti) = fi. 
For initial conditions expressed as c(0) and c¢(0), the 
solution is 


e 4 t 


1 — et + at—1 
e) = (0) + ——— ¢(0) + pW) 
a a : 
and, consequently, 


— —at 


c(t) = e-*é(0) + fi 


(2) 


‘Therefore, the relation between the initial conditions 
for the next sampling period, c(7) and ¢(7), and the 
present ones is of the form 


eae 


Let us denote by A the matrix appearing in (3), namely, 


4 


Ruta 
Aisa lie 2 | 2 


an 


Since the relation (3) is fundamental for the rest of this 
paper, it is worthwhile to change variables in order to 
give it as simple a form as possible. This change of vari- 
able is not indispensable; however, it does simplify con- 
siderably the geometric representation of the linear 
transformation defined by A and consequently helps in 
visualizing the discussion that follows. For this pur- 
pose, let us think in terms of the vector c(k7’) defined by 
its components c(k7), ¢(kT); where k=O, 1, 2,---. 
The vector c(k7T) can be-expressed in terms of the nor- 


malized eigenvectors of A, e1, e2, 
c(kT) = yilkT )e1 i y(kT ex (k = OM yas F (5) 


A standard computation gives 


( 1 
1 2 
Ne ee ea, = Me PT ; 
a 
VY1+ a 
ant! 
Ao = 1, e:= ( ). 
0 


Thinking in terms of the vector y(k7) defined by its 
components yi(R7), y2(RT), (3) takes the form 


y(T) =Ay(0) + fad (6) 


tora 


(fee ae eT) (1 a6 a?) 1/2 
== Opie ). 


where 


and 


di (8) 


It is clear that for the general interval (k-1)T <t<kT 
(6) reads 


xy(kT) =Ay((k—1)7T) +fid (k =1,2,3,---). (9) 


’ 


———s 
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IV. CLASSIFICATION OF INITIAL STATES 


The initial conditions c(0), ¢(0) can also be specified 
by (0) as can be readily seen from (5). We shall refer 
to the vector y(0) as the initial state of the system and 
think of it as the point (71(0), y2(0)) in the (y1, y2) plane. 

It follows from (9) that if the initial state y(0) is such 
that the system can be brought to equilibrium in N 
sampling periods, the following relation holds: 


v(NT) = 0 =A¥r(0) + fpAX Id + foA¥—2d +... 


+ fy-1Ad + frd (10) 
where 
eee ls 2) 2) 
and the values of the forcing function fi, fo, +++, fy 


depend on the particular initial state y(0) under con- 
sideration. 
For £=1, 2, 3, - + - , define 


— eT g-2(1 — eT)(1 + ts) net 


rr, = —A*d = ( 
TE 


The vectors r; are shown on Fig. 4. Let us note also that 
since a@>0, the y:1 components of the r; increase ex- 
ponentially with z. 

If we now premultiply (10) by A and use (11) we get 


N 
(0) = >\ fir, where |f;| <1foralli, (12) 
i=1 
which is a general representation for the initial states 
that can be brought into equilibrium in N sampling pe- 
riods or less. Eq. (12) is the basic relation for the classifi- 
cation of initial states. For convenience, let us intro- 


duce a 


Definition: Ry’ is the set of initial states that can be 
brought to equilibrium in V sampling periods or less. 

We shall presently obtain the shape of the region of 
Ry’. For convenience, we shall detail the steps of the 
reasoning in the form of theorems. 


Theorem 1: The region Ry’ is convex, 7.e., if two initial 
states represented by the points P; and P: can be 
brought to equilibrium in N sampling periods or less, 
the same is true for any initial state on the line segment 
P,P». 

Proof: Let OP; be represented by y(0). Since P; lies in 
Rr’, 


N 
7(0) = >> fir; where 
g=1 
Similarly, let OP: be represented by y’(0). Then since 
Py lies in Ry’, : 


¥'(0) = Sie, where | fi Splgttae= “1, 25 * = aus (14) 


a1 
Let us write f;/ =f; Afi; consequently, any point on the 


ag 


S- 
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Fig. 4—Illustration of the vectors r; and d. 
line segment P,P: can be represented by 


N 
Dd (fit oAfir; where 0<6<1. (15) 


a1 
The inequalities in (13) and (14) imply that for any 6 
in the interval 0<6<1 


Gee NAc | 


hence, the vector sum (15) has the standard form (12) 
irrespective of the value of 6, and represents a point in 
Ry’. 


(bet Zee aN): 


0: ED: 
We can now precisely define the region Ry’ by its 
boundary. This is done by 


Theorem 2: Ry’ is the closed set whose boundary is the 
convex polygon IIy which has the following 2 N vertices:' 


ORT Ss iia et ee TN, 

OP i Selatan ahs kek CN, 
OPy=n+rtrt-::+4y 

OPS = ni re 

OPS ae ie Lert eae deat 
OPanie =. fi fy ry (16) 


where O is the origin of the (y1, Y2) plane. 
1 Figs. 6-8 illustrate the case N+2, 3 and 4. 
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Proof: Let us observe that P; is the point symmetric to 
P_; with respect to the origin O of the plane (1, ¥2). 
Therefore, the convex polygon IIy has the origin as a 
center of symmetry. 

Let P be an arbitrary interior point of Ry’ (see Fig. 
5). The line drawn from the origin O through P inter- 
sects the edges P,Pr41 and P_;P_as1y of ly at the 
points Q; and Q_,, respectively. 

From the definition of Px, Psi, P_x, P—cr41) we have 
the following representations: 


OG brit foi “fhe Olean —tepo—) °  ty 
= WES ee Tee 
OO areas hy fo ee Feat a The! LN 


Mgpren yeast Vans 


Upon examination of these two expressions with (12), 
it follows that Q; and Q_; can be brought to equilibrium 
in N sampling periods. Since P lies on the segment 
O,.Q_x, by Theorem 1 the same holds true for P. 

This establishes the fact that any interior point of 
Ily and any boundary point of Ily belongs to Rw’. In 
short, any point in IIy belongs to Rw’. It remains to 
establish the converse property, namely, that no point 
outside the polygon IIy can belong to Ry’. 

Consider now an arbitrary point P outside IIly. We 
show that P cannot be brought to the origin in N 
sampling periods or less, 7.e., it cannot be expressed in 
the form of (12) and hence does not belong to Ry’. Sup- 
pose P could be brought to the origin in exactly N 
sampling periods and no less. Then 


OP = firs 1S, = LR Ee ES np 
Ee ores in ae rere (19) 


where 


ee & 1 


Since P is outside IIy, OP intersects the boundary of 
IIly at some point Q. Let QO be on the edge P;Pi4i. Then 


OOS eee toe ates Ole eae — ay 
where 
—-1<6<1. 


Clearly, one representation for the f;’”’s of (19) is 


; | OP | oie Z, 

pee erOG|| 
f, 6 ike < 
So ail aot 

y | 0g | 

— —17i=(k+2,---,WN). 
f ‘oP < a= (k+ N) 


Thus, all f;’”’s with the possible exception of f’’,41 have 
absolute values greater than unity. It will be possible to 
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Fig. 6—The region R,’ and R»’ with the vertices shown explicitly. 


bring P to equilibrium in N sampling periods (as as- 
sumed above) only if there exists some modification of 
the f;’’, say f;’’+A,, such that if the f;’”’s are replaced 
by the f;’’+A,’s (19) still holds, and fil’ +A; ib sige 
4=1, 2, 3, +--+, N. Hence, by subtraction, 


k N 
DS FA aE Artilhti = Ds Air; = 0 


i=1 k=2 
with 
A; <0 for 1= 


A; >0 for 


Taees eee 
ARS oe ee Se eee 


= 


Hence, 


eG 


=a Saay 


k+2 


k 
Animes: = D2 | A, | ri 
j=0 


This relationship cannot hold irrespective of the sign of 
Axi. Observe that the angles of the vectors ri, ro, +: - , 
ry (see Fig. 4) with the axis yz increase monotonically 
with the subscript z of r;. Thus, if px: is a unit vector 
perpendicular to rz41 and such that 

Prpiti > 0 for (iad Rene EEE 
then, 


pint <0 for C=) Res Roos = eb 
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Therefore, if we take the scalar product of both sides of 
the equality by pri, the left-hand side is zero and the 
right-hand side is >0. This contradiction proves that 
assumption that P could be brought to equilibrium in NV 
sampling periods and be outside IIy is false. 
OED, 

The polygon IIy41 has 2(N-+1) vertices Py’, Ps’, +--+, 
Pie eel aoe 8 EP Sy aay Krom: (16) it follows 
that a) for k=1, 2, ---, N, OP,’ is obtained from OP, 
by adding —ry41 and OP’; by adding ry4: to OP_;; 
b) OP’ wai — OPy ry and OP! -ay — OP_n Tae Steuile 
Since the regions Ry’ and R’y4; are defined completely 
by the polygon Ily and Iy41, respectively, we have a 
recursion rule for obtaining R’y4; from Ry’: 

The boundary of R’y41 is obtained by adding +ry41 
in an outward direction to the boundary of Ry’. 

A stronger statement that is implied in Theorem 2 is 
that any point P in R’y4; but not in Ry’ can be written 
as 


with | fwai| <4 (20) 


OP = O@ + fwsitnsi 


where Q is a point on the boundary of II, and fyyirwas 
points in the outward direction. For example, in Fig. 7, 
it is apparent that the boundary of R;’ is obtained from 
that of R,’ by adding rz in an outward direction, and in 
Fig. 8, that of R4’ is obtained from that of R3’ by adding 
rs in an outward direction. For convenience we wish to 
introduce the 


Definition: Ry is the set of all initial states that can be 
brought to the origin in NV sampling periods and no less. 
From the definition of Ry and Ry’ we have the obvious 


Theorem 3: Ry=Ry’—R’'y-i, 1.e., Ry is obtained by 
deleting from Ry’ all the points that belong to R’y-1. 


V. OPTIMAL STRATEGIES 


We define an optimal strategy by the following require- 
ment: given a (0) that is a point of Ry, an optimal 
strategy is any effective forcing function f(t), specified by 
fi, fo, ++ +, fx, that brings the point y(0) to the origin 
in exactly N sampling periods. 

Let us observe that since the two vectors r; and fr 
are linearly independent it follows that if either (0) 
lies in R; or Rz, the optimal strategy is unique. This is a 
consequence of the fact that the two linear algebraic 
equations in f; and f2 implied by 


(0) = fit + fore 


have a unique solution. 

We note also that if +(0) belongs to Ry with N23, the 
corresponding set of two linear algebraic equations im- 
plied by 2 
(0) = fara + foro + +--+ + ftw 


may have more than one solution. In order to proceed 
further, we define - 
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Fig. 8—The region R;’, Re’, R;’ and R,’ with 
the vertices shown explicitly. 


The outer boundary of Ry consists of the edges P_yP,, 
P,P;,++-+, Py«sPyand the edges Pi ywP_1,PiP_., °--, 
J ay en 


An interior state of Ry is any state not on the outer 
boundary of Ry. 


A boundary state of Ry is any state on the outer bound- 
ary of Ry. 

Theorem 4: Let N be an integer larger than 2. For any 
y(0) that is an interior state of Ry, there exists an in- 
finite number of optimal strategies. For any y(0Q) that 
is a boundary state of Ry, there is a unique optimal 
strategy. 
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To prove Theorem 4 we rewrite (6) 
(Oe aay pen) Ate: 
and using (11) 


v(0) — firs = AY (T). (21) 


If y(0) is in Ry, then by the definition of the optimal 
strategy, an optimal value of fi is such that y(7) is in 
Ry_-1. An equivalent form of (21) expressed in terms of 
regions Ry and Ry_; is 


Ryn = fiti = INN Ra ae (22) 


The interpretation of (22) is as follows: Start with 
Ry-1, determine A~!Ry-1; Ry is then generated by 
translating A~!Ry_1 by all possible fir, with | fi << 
Conversely, if y(0) is in Ry, there is an fi, where 
| fi <1, such that (0) —fir: is in A~'Ry_1. An optimal 
value of the forcing function during the first sampling 
interval is then any such value of fi. 

In order to determine A7!Ry_1, 
Theorem 3 that 


we have from 


Re SU ae 


and therefore, 


—1 —1 —1 ! 
A RN =A Ry_1 —A Ry_2. (23) 


Since R’y_1 and R’y_2are convex, A“!R’y_, and A-!R’y_» 
are convex; hence, we need only consider the vertices of 
A1R’y and A~!R’y_». In evaluating (23) we will take 
a specific value of NV, say N=4. The regions R.’, R3’ and 
R,’ are shown in Figs. 7-9. The cross-hatched area in 
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“EL Le tatl, 
wf Lotts b 
ope eea ZG 
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Fig. 9—The cross-hatched area is the set A“R3. 
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Fig. 9 is A~1Rk;. Table I gives a complete tabulation of 
the vertices. In the table use was made of the fact that 


IN Te, = Fr (n = 1, 2 oe” ) 


which is a consequence of (11). 

In Fig. 10 we take an arbitrary interior initial state 
7(0), which is in Ry, and show how it is translated by 
fit: with —1<f;<1. Clearly, f’ is an optimal value of 
the forcing function since +(0) —f’r; is in A713. Simi- 
larly, f’’ is an optimal value of the forcing function since 
(0) —f’’r is in A~!R3. It is apparent that any fi in the 
range f’<fi</’’ is an optimal value of the forcing func- 
tion. If y(Q) is an interior state of Ru, f’Af’’ and, hence, 


TABLE I 


Vertices of Convex Region Ry’ 
Tji—fy— 03 4 —n+r+r3+r 
mt+re—r3—4r4 —r—rtr3+ry 
ty+f2+r3—4r4 Ai fii Ia As Te 


ritfretrst+re Tie aed 
Vertices of Convex Region R;’ 
t1—f2.—f3 —rn+re+r3 
tm+f.—73 — fits 
rm+re+7r3 ee SMart Clee’ 
Vertices of Convex Region Re’ 
¢ Si limey €) SIGS 
ti+f2 —fri—fe2 
Vertices of Convex Region A-1R;' 
f—1r3—14 —ntrt+rs 
ro+r3—r4 Sie see 
fotr3try —1o—f3—1t 
Vertices of Convex Region A7!R,’ 
r2— 13 —f2+73 
te+r3 FESS 


Fig. 10—The definition of f’, f’’in terms of ¥(0) and of the set AR;, 
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there is an infinite number of optimal values for je ee. 
is on the outer boundary of Ry then, either 


Case 1: it is on an edge of the form 


lena OTE Ap eee (k= 1. D8, N= 1) 
or 
Case 2: itis on edge P_yP; or PyP.1. 

In the first case, 

O@ =ritre t+ > + target Ore — ree — + + — ry 


where —1<6<1 and 1<k<N~—1 (or the same expres- 
sion with the sign reversed). From this representation 
of OQ, it is clear that f,=-+1 is an optimal strategy. 
Furthermore, for such a state Q, —1</;<1 cannot be 
an optimal strategy: If | fi <1 were applied, at the 
next sampling period the point Q would be in Q, with, 
as a consequence of (6), 


O@: = AO@ + fid. 
From (11), 
Oe = ld rt re es 
+ orp + Ory — Pest — + + — 1. 
Define Q2 by 
O@2 = ri+r2+ 
thus, 


oar tat pee 1 Ole feed NR 


O@: = O@2 + (1 — fi)(—d). 


Q2 is on the edge P,1P; of Ilya. Since 1—fi>0, and 
since —d makes a smaller angle with the y2 axis than 
the edge Px-1 Px, Q1 is outside IIy_1. Hence, fi <1 cannot 
be an optimal policy, and fi= +1 is the unique optimal 
policy. 

In case 2, to be specific, assume Q to be on the edge 
P_yFP;. From the representation (16) of OP_y and OP,, 


O@ = 6r1—r2—1fr3-—---—ry where —1<6<1. 


Clearly, 6 is an optimal strategy. Furthermore, this 
optimal strategy is unique, 7.e., if fi%6, fi cannot be an 
optimal strategy. This can be shown by following ex- 


actly the same procedure as the one used in case 1. 
Q.E.D; 


VI. THE PROPOSED OPTIMAL STRATEGY 


The object of this section is to establish an optimal 
strategy which is easy to instrument and which is valid 
for any state belonging to Ry, where N is an arbitrary 
positive integer. 

Let us start by putting emphasis on two particular 
polygonal curves: 


The critical curve is obtained by joining successively the 
vertices defined by — 


N ee 
oe SR ret fiers ean Ds 2 


4=2 


(see Fig. 11); 


i=2 
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The polygonal curve K is obtained by joining successively 
the vertices defined by 


N 
Mee era, 
t=1 


N 
eRe Ata sg Ty 1 15, cae > Ly alierer 
i=1 


Theorem 5: If y(0) is in Ry it can be expressed either as 
y(0) =ritret- ++ +r, 4+ Oris 
(24) 


| LRM) Se LO ONG Tie ai tars dity 


or as 
BC eee tl hg Orme tT eee ee 
+ ty-1 + diry (25) 


where —1<6<1, 0<6,<1, 0<R<N-—1. Note that the 
representation (24) holds for all points to the right of 
the polygonal curve K and (25) holds for those that lie 
to the left of the polygonal curve K. 

Proof: Observe first that from (17) and (18) any bound- 
ary state of Ry_1 can be written either as 


Varley RY gh yg OP em a UR PN Wied TEM Cot Sa A) Ga) 
or as 
—ri—fe— es — gt regi t rape t+ ++ trv (18’) 


where —1<6<1 and 0<k<N-—1. Observe further that 
(0) being in Ry implies that the point (0) can be ob- 
tained from a boundary point of Ry-1 by adding in an 


% 


Polygonal Curve K 


Critical Curve 


Critical Curve 


Polygonal Curve K 


Fig. 11—The initial curve and the polygonal curve K. 
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outward direction the vector 6iry with | 5: <1. [See 
(20).| The relations (24) and (25) simply reflect that 
particular fact. For the boundary states of Ry_i repre- 
sented by (17’) [(18’), respectively | the outward direc- 
tion is given by —diry (+6iry, respectively) with 
O01 
Orn WD: 

The proposed optimal strategy follows directly from 
the canonical representations (24), (25). To get started 
consider those initial states for which k=0 in (24) and 
(25 ete, 


(0) = 6r1 — ro — 3 — ++ > — ry-1 — Oiry 
—-1<6<1 

y(0) =6ri+rotr3+ +--+ ry-1+ bry 

or 

(0) — 6r1 = — re — 73 — > > * — ty-1 — bity 
—i<6d<il 


7 (0) SS OFu— fo Fs > Tea Oi. 


In both equations (26), the right-hand side represents a 
point on the critical curve. Observe that 


1) If k>0, the optimal strategy implied by (24), (25) 
requires fi= +1; , 

2) lf R=0 and if | 5| =1, then the optimal strategy 
ey by (24) and (25) requires f,=6, 2.e., 
fi =1; 

3) If R=0 and if | 5| <1, then f,=6 where 6 is such 
that (0) —6r, be a point on the critical curve. 


(26) 


This leads to the following rule for determining fi. 


Rule: Compute 6’ such that y(0) —6’r, be a point on the 
critical curve. If 6’>1, take fi=1, where fi is the effec- 
tive forcing function for the first sampling period. If 
6’<—1, take fi=—1. If —1<6’<1, take f,=6’. 

This rule is the only rule required. This follows from 
Bellman’s principle of optimality [5] since at each 
sampling instant one may take the point of view that it 
is a new problem that is just starting; so that at each 
sampling instant the problem is to determine the opti- 
mal f; which is precisely what the rule above accom- 
plishes. 


VII. IMPLEMENTATION OF THE PROPOSED 
OPTIMAL STRATEGY 


The proposed optimal strategy is completely defined 
by the rule of the preceding section: Thus, at each sam- 
pling instant we need to compute 6’ such that y(0) —6’r 
be a point on the critical curve. 

The first step is to transform the critical curve from 
the (71, Y2) plane to the (c, é) plane, since c(é) is the input 
to the computer. From Section III it follows that the 


WECLOLSe Si,)S2,)° 2); Sy; °. +, 0l1-the (¢, ¢) plane cor- 
responding to the vectors ri, ro,---,ryv,--:-+, of the 
(¥1, Y2) plane are given by 

s, = Er; (& = 1, 2,3,+--) (27) 


February 


where E is the matrix which has the eigenvectors e; and 
e, as columns. These vectors are shown in Fig. 12. Sim- 
ilarly, the critical curve can be drawn in the (c, ¢) plane. 
However, since the proposed optimal strategy requires 
the determination of 6’ such that c(0) —6’s; be a point 
of the critical curve, it is more convenient to rotate the 
coordinates and use the axes OX, and OX2, shown in 
Fig. 12, which are orthogonal, where OX, is the support 
of s:. Thus, in the (x1, x2) coordinates, the determination 
of 6’ will amount to taking a difference of abscissas. 

The transformation law between the vector c(0) of 
the (c, ¢) plane to the vector x(0) of the (1, %2) plane is 
the rotation 


x(0) = Te(O) 
where 
| cos@ sin “| 
f Re ; : 
—sin @ cos@ 


Similarly, the vectors s;’ of the (x, x2) plane which cor- 
responds to the vectors s; of the (c, ¢) plane are obtained 


by 
S =Ls7 (i= a2 See 


The critical curve (7.e., the curve that joins successively 
the vertices defined by 
N 
. . . — Se si, . . 
2 


/ , / / le , 
* 5 Ss — S25 89 S25 Stet S35 > uae 


N 
+ Be, a sane) 
2} 


S4 


Fig. 12—The new axes Ox, Ox2, Ox3 shown with respect to the old axes, 
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in the (x1, x2) plane is shown in Fig. 13. Also illustrated 
is the determination of 6’ for a given x O)eeli gf oc.(0) is 
the abscissa of the critical curve corresponding to the 
ordinate x2(0) of x(0), then 


f(x2(0)) — x,(0) 


oat 


Fig. 14 shows a block diagram of the computer: 1) from 
c(t), c(t) is obtained by differentiation; 2) using c(0) and 
c(0), x(0) is obtained by performing the linear trans- 
formation x(0)=Tc(0) (see detailed analog computer 
diagram, Fig. 15); 3) f(x2(0)), the abscissa of the critical 
curve is obtained by the function generator, shown in 
detail in Fig. 16; 4) from 6’ the saturating amplifier 
gives fi, the optimal effective forcing function. 

The details of the function generator are shown in 
Fig. 16 [6]. The input to the function generator is x2(0) 
and —x2(0). The output of the function generator is 
—f(%x2) which is the critical curve reflected about the x2 
axis. This is the dashed curve shown in Fig. 17. The 
output of Amplifier A; is then the required value of 6’. 

The method by which the reflected critical curve is 
broken up in order that it may be generated by diode 
circuits as summation of monotonic functions is shown 
in Fig. 17. Each of the monotonic functions M; is speci- 
fied by a breakpoint BP; and a slope as specified by the 
angle @;. The relationship of BP,’s and @¢,;’s with the 
critical curve is clearly shown in Fig. 17. For each M; 
to be generated a diode circuit with its associated break- 
point and the slope control is required. Fig. 16 shows 
the standard physical setup. 


VIII. CoMPARISON WITH THE CONTINUOUS CASE 


It is well known [1]-{3] that the optimal strategy for 
a second-order continuous system consists of applying 
maximum positive or maximum negative excitation at 
all times till equilibrium is reached. The change from 
one to the other excitation takes place at a definite time. 
The precise instant at which switching takes place is 
that instant when the representative phase plane point 
reaches the switching curve. This curve consists of that 
trajectory which terminates at the origin when maxi- 
mum positive excitation is applied and that trajectory 
which terminates at the origin when maximum negative 
excitation is applied. The strategy for the continuous 
system is then to apply that maximum excitation to 
bring the state of the system to the switching curve and, 
at that instant, reverse the sign of the excitation. 

In the following we are going to prove a theorem ex- 
hibiting the relation between the optimal strategy for 
the sampled system and that known one for the cor- 
responding continuous system. As is expected intui- 
tively, the proposed optimal strategy for the sampled 
system coincides in the limit as T7—0 with that of the 
continuous system. 

_ Before stating precisely the relation Ranecs the 
optimal strategies let us recall the polygonal curve, 
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The polygonal curve K is obtained by joining succes- 
sively the vertices defined by 


peel ty Fils Teele feat ens) 


N 
Sane 
1 
N 
+ rie 
1 


The vertices of the polygonal curve K are shown on 
Kio 41. 

Reference to Theorem 5 and (24) shows that, typi- 
cally, the optimal forcing function is +1 for a number 
of sampling periods, then 6 with | 5] <1, and then —1 
for the remaining sampling periods except the last 
where it is —6;. If we would relabel 0 the instant at the 
end of the sampling period during which the forcing 
function was 6, one would have 

y(O) = ritre t+: ++ + ry eit bry; 
that is, by following the optimal strategy, the state 
point ends up by approaching the origin by jumping 
along the polygonal curve K. With this in mind, we 
state 


Theorem 6: Consider the sampled system shown in 
Fig. 1, together with the corresponding continuous 
system. Let S be the switching curve associated with 
the continuous system. Then 1) for every value of 7, 
the sampling period of the sampled system, the vertices 
of the polygonal curve K lie on the switching curve S. 
Thus, for every 7, the polygonal curve K is a piecewise 
linear approximation to the switching curve S. 2) As 
T—0, the proposed optimal strategy for the sampled 
system becomes identical to that of the continuous sys- 
tem. 


Proof: A general vertex point from the bottom half of 
the polygonal curve K of Fig. 11 is given by 


— ert ,/a? + 1 (@ ~~, ee) 
N N We 
OVy => im = x] 


n=) n=1 T/a 


Therefore, if the initial state is Vy, it will require NV 
sampling periods or NT seconds to reach the origin. 
Suppose now that the sampling period 7 is reduced to 
zero, while all the other parameters of the system re- 
main unchanged. In order to keep the initial state fixed, 
we must make N—- as 7-0 in such a manner that 
NT remains equal to its initial value f. In the limit we 


have 


TVae+1 a 


N=to/T N=to/T 2 
li seer lies | : 
ae ae F50) Gest T/a a 
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Fig. 13—The critical curve x;=f(x2) in the Oxix2 
plane in terms of the s;’’s. 
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Function 
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Linear 
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x(0)= TCO) 


Fig. 14—Block diagram of the computer gener- 
ating the optimal strategy. 
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Fig. 15—Detailed analog computer block diagram 
for the transformation x= Te. 
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Fig. 17—Illustration of the method for generating the reflected 
critical curve as a sum of monotonic functions. 
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The right-hand side is recognized to be in the form of a 
Riemann sum; hence, as 70, it is equal, in the limit, 
to the integral 


V e+i SJ 


to a 
{ jer. 
0 1/a 


The lower limit of integration is zero since 


lim it = 0. 
T=0 


Performing the integration we get 


Jae + et a D) 
|. (28) 


Let us now show that, provided NT=¢o, the point Vy 
remains fixed in the plane as 7-0 


to/ a 


N 
OVy = >> tx 
n=1 


JE FA (e? —1) 
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(e* + e2aT + sree + e1e) 


NT/a 
or 
VAL = EN aE) 
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OVy = (29) 


This expression is equal to the value of the integral (28) 
evaluated at t)= NT. Therefore, for any 7 and JN, the 
vertex Vy of the polygonal curve K lies on the continu- 
ous curve specified by (28). 

We now claim that (28) represents the switching 
curve of the continuous system in the (j71, Y2) coor- 
dinates. To establish this fact, the following procedure 
will be followed: (29) is transformed to the (c, é) co- 
ordinates by the linear transformation Eof (27). The re- 
sult is 


e*'0 — aty — 1 


a 


1 — eto 
(=: 
a 


By eliminating ¢) one obtains the equation 


Fp eg OO Aten) 


(30) 
a (ie 


of acurve of the (c, é) plane which, irrespective of the 
value of T, goes through the vertices of the polygonal 
curve K. 
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It remains to show that the curve (30) is the switch- 
ing curve of the corresponding continuous system. This 
is readily done by integrating the differential equation 

dé in 

Sa aie OG —« L 

dt 
and requiring that the trajectory pass through the 
origin. The result is 

¢ 1 

c= in 1" ae) 
a a* 


which is identical to (30). Thus, the first assertion of the 
theorem is established. 

As T->0, m-—0, therefore the critical curve and the 
polygonal curve K become identical in the limit to the 
switching curve S. Therefore, in the limit as 7-0, the 
proposed optimal strategy requires thatthe forcing 
function be +1 for states to the left of the switching 
curve S and —1 for states to the right of the switching 
curve S, as can be seen from Fig. 17. In other words, as 
T—0, the proposed optimal strategy for the sampled 
system becomes identical to that of the continuous sys- 
tem. 


Q.E.D. 
IX. CONCLUSION 


This paper has solved the problem of finding, prov- 
ing and implementing the optimal strategy for the 
sampled-data servo of Fig. 1. The key to the solution 
was the general representation (24), (25) of the states 
from which the origin can be reached in N sampling 
periods and no less. The implementation of the pro- 
posed optimal strategy is shown in Fig. 14. It is interest- 
ing to note that in the second-order sampled data case, 
the forcing function is not always as large as possible in 
absolute value. In the continuous case, it can be shown 
{7 |-[9] under very general conditions that the optimal 
forcing function always has its absolute value as large as 
possible. 
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Time-Optimal Control of Higher-Order Systems” 


FRED B. SMITH, Jr.t 


Summary—Practical extension of time-optimal control to systems 
of higher order than three has been limited primarily by difficulties 
in physically representing surfaces in a phase space of these higher 
dimensions. A method is presented here for obtaining the forcing 
function as a function of the state variables without requiring use of 
the phase space concept. On line solution of a set of transcendental 
equations is required. Results of a digital simulation of a fourth- 
order, real-root, single-degree-of-freedom system are presented. In 
a digital solution the system operates as a series of short open-loop 
control intervals. The effect of including derivatives of the input for 
prediction is shown for second-order model inputs. 


INTRODUCTION 
eye: the last ten years there has been consid- 


erable interest shown in the literature in improv- 
ing the characteristics of basically linear systems 
by introducing a nonlinearity into the control loop. A 
common nonlinearity introduced has been a relay repre- 
senting a saturation or maximum permitted forcing 
function. When used with a linear switching function, it 
has led to a practical high-gain system exhibiting many 
of the characteristics of an adaptive system [1]. A 
second characteristic which has received attention is 
that of response time, subject to a limited forcing func- 
tion. Under various titles—“Optimum Relay Control 
System,” “Bang-Bang Control Problems,” “Predictor 
Switching”—the concern has been that of bringing the 
error and its m—1 derivatives to zero in minimum time 
after a step displacement subject to a limited forcing 
function. The early work of Hopkin [2], McDonald 
[3], and Bushaw [4] in the phase plane rather thor- 
oughly investigated second-order systems and showed 
their feasability. The works of LaSalle [5], Bellman, 
Glicksberg, and Gross [6], and Bass [7] generalized 
this and put time-optimal, or minimum response time 
regulation on a firm mathematical foundation for sys- 
tems of arbitrary order subject to certain conditions on 
the roots. Recently, under the instigation of Pontriagin, 
a number of Russian investigators have approached the 
problem from a different aspect and have added an in- 
teresting geometrical interpretation of the optimum 
control problem [8|-[11]. While these works added 
considerable insight into the problem and showed the 
existence and nature of the solutions, they have not as 
yet yielded a simple method for obtaining practical con- 
trol systems of high order. 
There are at least two difficultities encountered when 
attempting to obtain higher-order time optimal regula- 
tion or control. The first is that of obtaining the forcing 
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function sign as a function of the state variables. The 
usual approach has been through the phase space con- 
cept [13]. In principle this is a straight-forward exten- 
sion of the phase plane analysis which is so useful in 
second-order nonlinear problems. In practice, however, 
it is not so simple. As the order of the system increases, 
the mathematical manipulation required to eliminate 
time from the solutions becomes complex, and the hard- 
ware required to express these switching surfaces be- 
comes prohibitive. 

Although a number of third-order systems have been 
done using electro-optical, two-variable function gen- 
erators, two single-variable function generators properly 
switched, and digital computers for obtaining the phase 
space switching surfaces [12|-[16], none of these seem 
practical to extend beyond third order. The recent 
method of Kurzweil [16] may be a possible exception to 
this. 

The second difficulty which has been mentioned as be- 
ing a block in the way~oef extension to higher orders is 
that of measurement of the controlled variables. The 
usual transfer function approach to single-variable con- 
trol synthesis leads one to talk about the controlled vari- 
able and its n—1 derivatives as making up the state 
vector to be controlled. Because of noise, it is not usu- 
ally possible to measure directly by differentiation more 
than one or possibly two derivatives. However, high- 
order systems are generally made up of coupled first- 
or second-order systems. It is these physical variables 
which appear in the equations of motion as initially de- 
rived, and they can be measured. If it is desired to con- 
trol a single variable and its (7—1) derivatives instead 
of controlling the variables independently, then it is 
usually possible to write the derivatives as a linear 
combination of these physical variables and the forcing 
function [17], [18]. This paper does not treat the in- 
teresting problem of what to control, but concentrates 
on a method for determining the forcing function. 


A NONPHASE SPACE METHOD FOR OBTAINING 
OPTIMUM SWITCHING 


Hopkin and Wang [20], before going on to solve their 
problem in phase space, mentioned briefly the possibil- 
ity of using switching times for determining the forcing 
function. Recently, Lee [19] suggested in more detail a 
technique for obtaining the forcing function sign with- 
out requiring the concept of switching surfaces in the 
phase space. The method presented here is essentially 
his, but utilizes some of the properties of time-optimal 
switching as proved by him and others to simplify the 
numerical computation required. Briefly, the technique 
is as follows. 
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Consider the system to be controlled as described by 
the set of first-order differential equations: 


& @i1 ** > Gin xy by 

Xe g X92 by 
. === . . + . Ue (1) 
Gr Qni** * Ann Xn by, 


Here the x,’s are the variables to be controlled— 
either the physical variables of the system or linear 
combinations of them. Only a single forcing function u 
is considered and is restricted to be | u| =1 for all time 
less than the response time. In more compact notation, 
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_ =e 
Res tla) [e-™TV,(T) a Vi(0) | 
Biu 
(as) 
i le" V (2) = V2(0} 
Bou 
+(—o,) -_ 
1 + ——— [e™TV,,(T) — V,,(0) | 
Bou 
(1) is written 
= Ax+ Bu. (1a) 


Now to simplify integration of these equations, we 
transform to principal coordinates, 7.e., find a trans- 
formation matrix S such that 
S-'1AS = D, a diagonal matrix. 
Making the substitution 
Va S47: f= SB 


in (1a), we obtain the principal coordinate equations of 
motion, 


V = DV + Bu. 


The solution of these equations is 


(2) 


fie 
V(T) = ®(T)V(o) +f (7) (r) Budr, (3) 
0 
where ®(7) =e?" is the fundamental matrix of the sys- 
tem ®—!(r) =®@(—7) =e-” for this constant coefficient 
system. From previous studies it is known that for time- 
optimal control, the forcing function uw will take on val- 
ues of only w= +1 for time less than 7, and for the case 
of real distinct roots will change sign at most (n—1) 
times during the time interval zero to 7. What is not 
known, and indeed what is the heart of the problem, is 
whether its initial value should be plus one or minus one. 
To solve this we consider both cases, assuming that the 
forcing function will be made zero at time 7. Multiply- 
ing (3) by ®-1(7), and breaking the integral into m sec- 
tions with constant forcing functions changing sign in 
successive sections, one obtains 


Ce (V1) 3.0) = “| f GoG@uar 
0 


~ f eecar Ore af o\(r)adr |. (4) 
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(4) when integrated becomes 
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The 2 unknowns, h, - - tna, 1 are the ‘times vat 
which the forcing function must change sign so that at 
time T the system will be at the desired V(7), starting 
from V(o) at time=0. If the m equations assuming an 
initial plus uw are solved for a set of positive ordered 
switching tines, 7.e., 0<ti<to + + + tpn-1<ZT, and the same 
is done for an initial negative sign, then the sign cor- 
responding to the set of equations with the minimum 7" 
is the correct optimum initial sign for that set of initial 
conditions. Since for a system with real distinct roots 
and at most (7—1) switches, the switching surfaces to 
arrive at the origin are unique [13], the sets of equa- 
tions (7) can have only one set of positive-ordered 
roots. 

If now the system could be assumed to have a con- 
stant V(7), and were subject to no external disturbance, 
then the system could be operated open-loop with the 
forcing function changing sign at the times hf, fs, - - 
t,-1 and being turned off at 7. This assumption is not 
usually the case with practical systems. Consequently, 
it is necessary to consider each point in time (time now) 
as time zero, and to resolve the equations with the 
present value of coordinates as initial conditions ob- 
taining a new choice sign. This is illustrated in Fig. 1 for 
a system with pure inertia. It is assumed that «(7) =0, 
x2(0) =0, x1(0) =0.7; 7.e., we want to return to the origin 
after a step displacement of x;. Curve A shows the path 
of the system if there are no external disturbances. 
Curve B shows the path when the system is subjected 
to a constant external force of 0.5 for a period of 0.8 
second. Fig. 2 shows the computed switching times for 
these two conditions as a function of time. 
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Fig. 1—Phase trajectories of pure inertia-undisturbed and disturbed 
by constant external forcing function for 0.8 second. 
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Fig. 2—Predicted switching times along disturbed 
and undisturbed trajectories. 


SIMULATION OF A FOURTH-ORDER SYSTEM 


As an example of the way in which this method is 
used, consider the fourth-order single-degree-of-freedom 
system: 


1 Cae 0 0 


lie 0 
a Ome 0 1 0 Xo 0 
“|= JCEM pause 
x3 O-se50, 0 1 x3 0 
X4 05024138; 051° —0.268 x4 1 


It has a transfer function of the form 
k 
s(s + a1)(s + a2)(s + as)’ 


which might represent positional control of a motor 
through a filtered power amplifier. Roots of the system 
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were chosen to be +1.40, —1.47, —0.2. The coordinates 
being controlled are x; and its three derivatives. The 
implicit switching equations (5) for this system are 
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Most investigators in the past have put V(T7) =0, ze., 
have worked the regulation problem. Hopkin and Wang 
[20] in their second-order investigation assumed the 
input V(¢) could be adequately described by a three- 
term expansion with the coefficients being the present 
measured value of V and its first two derivatives. This 
will be done here, and the effect of including these pre- 
diction terms will be shown for one type of input. 

Although it is felt that (7) can be solved in analog 
fashion, the present simulations have been done digi- 
tally, with (7) being solved by a simple iteration pro- 
cedure. The exponentials are approximated by a two- 
term series expansion (keeping linear terms in the 
switching times), and for each iteration the switching 
times are changed by an increment proportional to the 
increment which would make the linear approximation 
equal to zero. No convergence problems were experi- 
enced with this real root system. The only difficulty oc- 
curs when the initial guess for the switching times is 
considerably less than the positive-ordered set which 
satisfies the equations. Convergence then occurs on an 
unordered solution. Because the linear approximation 
is singular when two switching times are equal (which 
occurs on the switching boundary), it is necessary to 
work slightly off the exact switching surface. This re- 
sults in a small steady-state limit cycle. 

Because of the finite time required to obtain an itera- 
tive solution, there is a delay from the time the co- 
ordinates are read in until a corresponding solution is 
found. During this time the system is operating open- 
loop on the previous solution. In truth then, the 
sampled system operates as a series of short open-loop 
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intervals. This differs from the usual sampled-data 
systems where the forcing term changes only at the 
sampling time. It results in good control as long as ex- 
ternal forces do not change switching times much dur- 
ing the open-loop intervals. Of course, the smaller the 
expected outside influences, the slower can be the com- 
puter. For most of the traces presented here, the IBM- 
650 was scaled to one millisecond per iteration. For 
the inputs shown, an average of 5—6 iterations was re- 
quired for each new set of coordinates. For inputs of 
Figs. 6 to 8, switching times were all maintained at 
less than one second. 

Fig. 3 is a rough schematic of the closed-loop system. 

Fig. 4 is a plot of switching times vs step input of 
x,/u. Fig. 5 shows the time response to a step input of 
x/u=0.01. The effect of having to switch slightly later 
than the correct time because of singularities on the 
switching surface mentioned earlier, is seen in the x3 and 
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Fig. 3—General time-optimal control loop. 
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x4 traces. This is the result of only 0.5-msec lag in the 
true switching time. A lag of 1 msec requires about 
twice the number of switches to obtain equivalent 
errors in x3 and x4. Effect on transient response is neg- 
ligible. 

Fig. 6 shows response of this fourth-order time-opti- 
mal regulator (solid line) to a step input through a 
second-order model with 0.5 damping and 1.5 rad/sec 
natural frequency (dashed line). No derivatives of the 
input have been included in the implicit switching equa- 
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Fig. 4—Switching times for step input of x1/u. 
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Fig. 6—Response of time-optimal system to second-order 
model input—no prediction of input. 
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Fig. 7—Response of time-optimal system to second-order model 
input—first-derivative prediction of input at 7. 


tions. Since the system is then being driven to the 
present value of the input, and this is changing quite 
rapidly during the first three seconds, there is a consid- 
erable lag in response. A high-frequency chatter of the 
relay is evidenced in the x4 trace. Only the gross over-all 
motion is shown in x. There is a much higher frequency, 
a function of the switching error, which does not show on 
this scale. 

Fig. 7 is the response to the same input, but with a 
first-derivative prediction term included. Following is 
much better and the very high frequency chatter is re- 
duced. 

Fig. 8 shows the response when both the first and 
second derivatives are used for prediction. It is felt that 
the step initial condition in x;/u% may be the cause of 
the overshoot. This is not too surprising, since the sys- 
tem is trying to catch up in minimum time and is not 
affected by what happens in between. 


CONCLUSION 


It is felt that the work presented here shows that 
time-optimal control of high-order systems with real 
roots is definitely feasible. For a digital system, limita- 
tions on the order of systems possible will be due to 
computer speed. The smaller the relative size of outside 
influences, the slower can be the computer. It is a rela- 
tively easy matter to include the derivatives of the 
input in the optimum switching solution. Thus.the con- 
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Fig. 8—Response of time-optimal system to second-order model 
input—first- and second-derivative prediction of input at 7. 


trol problem, in addition to the regulator problem, may 
be solved. It has been shown that inclusion of these pre- 
diction terms gives markedly better following. 
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Discussion 


F. B. Tuteur (Yale University, New Haven, Conn.) 


This paper presents an analytical procedure for obtain- 
ing the switching times in a high-order relay servo. The 
analytical solution for the switching times must in prac- 
tice be implemented by a digital computer, but since 
the previous approach of using graphical (7.e., phase 
plane or phase space) switching boundaries could be 
used easily only with second- or third-order systems, 
the present approach is a definite contribution to the 
theory of optimum switched systems. 

There is, of course, some question in all systems of 
this type as to whether the complexity of the optimum 
controller is really worth the extra performance that is 
obtainable. Thus, in a second-order system the im- 
provement in rise time, etc., which is obtainable from a 
switched system is usually no more than about 50 per 
cent better than that of the linear system, particularly 
when inputs are sufficiently large to saturate parts of 
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the “linear,” system. In the present instance, the author 
required an IBM-650 computer to control a relatively 
simple system. Although a special-purpose computer 
could probably be used, the computations are quite 
complex, and it seems that even a special-purpose com- 
puter would still be quite large and bulky, and there- 
fore not very practical. I would be interested in com- 
ments by the author on this point. 


Author’s Comments: Dr. Tuteur raises the very valid 
and significant question of the practicality of optimal 
controllers—whether their advantages and improve- 
ments over conventional linear systems justify the addi- 
tional complexity. It is, of course, a question which can- 
not be definitely answered in general at the present 
time. Theoretical work on optimal systems is relatively 
new and mechanization of such systems is still in its 
infancy. (Time-optimal control, on which this paper con- 
centrates, is a special case of the general optimal con- 
trol problem.) It is certain that a conclusion on their 
usefulness cannot be reached until tentative mechaniza- 
tions are obtained and advantages of the systems are 
established. This paper is a step in that direction. 

In spite of their infancy, however, I think it is possible 
to conjecture a bit on the potential usefulness of optimal 
controllers. It seems likely that they will always be 
more complex than the present-day linear controllers; 
in cases where the latter do an adequate job, the former 
will be of use mainly as a goal towards which to shoot, 
or as a yardstick for comparison. It is in applications 
where conventional techniques leave something to be 
desired that optimum or approximations to optimum 
control will be of practical value. Such problems as 
rational design of controllers for high-order systems, 
multivariable control, control with constraints to be en- 
forced on some of the variables, control of systems with 
several independent but strongly coupled forcing func- 
tions, control of nonlinear plants, and adaptive control 
are all areas where additional complexity may be neces- 
sary to get the job done properly, if at all. Optimal con- 
trol theory offers a rational and promising approach to 
these problems. 
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Control System Performance Measures: 


as tealeteschte 


and Future 


W. C. SCHULTZ}, MEMBER, IRE, AND V. C. RIDEOUTT, FeLLow, IRE 


Summary—An increased amount of emphasis on the mathemati- 
cal formulation of control system performance can be found in recent 
literature on automatic control. There are two areas of control system 
theory in which the application of performance measures is of inter- 
est: 1) the evaluation of control system designs in general, and 
2) the design of adaptive control systems. In the former case, the 
performance measure is becoming an increasingly important aid to 
the control system designer. In the latter case, the performance 
measure takes on even greater significance, since adaptive systems 
include, by definition, a performance measure as an essential func- 
tion which permits correction of system dynamic response during 
actual operation. Furthermore, the over-all evaluation of the adaptive 
loop itself presents new problems in the choice and use of perform- 
ance criteria. 

In the past, emphasis has been placed on various types of inte- 
grals, such as integral of error-squared and integral of the product 
of time and absolute error (ITAE); present emphasis is being placed 
on forms of integrals of a more general type; the trend for future 
emphasis appears to be in applications of statistical concepts and in 
attacking the problem of choice of the error measure in the adaptive 
system. 


I. PERFORMANCE MEASURES: PAST 


ONTROL system theory has been greatly en- 
larged during the course of the last two decades. 


Many tools for the analysis and synthesis of such 
systems have been developed and expanded. These in- 
clude means for determining whether or not a system is 
stable, an important characteristic of any control sys- 
tem. Many criteria have been presented, such as those 
of Routh, Hurwitz, and Nyquist, which enable the 
linear servo designer to give a yes or no answer to the 
question, “Is the system stable?” 

There are various kinds of stability, at least in non- 
linear systems. However, stability alone, although a 
necessary requirement of a good system design, does 
not guarantee a suitable or usable system design. For 
example, specifications of accuracy and speed of per- 
formance must be met. Questions concerning perform- 
mance are more difficult to answer with a simple yes 
or no. 

The problem of obtaining the answer to such a ques- 
tion is one of obtaining one number, or a limited group 
of such numbers, to describe the whole error, and then 
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accepting or rejecting a system design on the basis of 
this number. In a mathematical sense, this number is a 
metric, since it gives the “distance” between two func- 
tions. The actual process of selecting which metric is to 
be used to “measure the distance” between a desired 
output time-function and an approximation to the de- 
sired function is, of course, the major difficulty. It is 
here that a certain amount of personal opinion is found. 
Surely the choice should be governed by usefulness, in 
that the particular metric which is selected must be a 
convenient one to use, as well as one which yields prac- 
tical results. 

Because real command signals, disturbances, and 
even system parameter values have random charac- 
teristics, it might be expected that choice of metrics or 
performance measures might be based upon statistical 
descriptions of these input functions. In the past, how- 
ever, such a basis for metric choice seems often to have 
been more intuitive than explicit, and considerations of 
mathematical or computer equipment have often hid- 
den a recognition of the underlying statistical problem. 

The written history of performance measures dates 
back to 1942, the earliest date of any published material 
found by the authors. The classified nature of the de- 
velopment of servomechanism theory during World War 
II contributed to the delay in publication. For example, 
an early paper to appear in this country on the subject 
is the one written by Hall [1] in 1943, which had the 
classification, “restricted.” 

Although it was not stated in an explicit mathemati- 
cal form of a metric, the first proposal of a measure of 
the error of a control system is the “deviation area” con- 
cept of Obradovic [2]. His paper appeared in a German 
publication in 1942. According to Obradovic, the start- 
ing point for obtaining the deviation area is to write the 
differential equation that describes the system, for 
example, 
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It is now possible to solve for F, as shown below, and to 
plot it vs time, as shown in Fig. 1. 


Fig. 1—Illustration of measure of error of Obradovic. 
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A good system, then, is typified by a small area F. 
Although it is not expressly stated as such, F may be 
called a metric, since it is a number which represents the 
“error” of the system. 

The mathematical basis of the theory of measure of 
error, as it has developed, was set forth by Wiener [3]. 
He speaks of “operators” on functions, and the choice of 
the “best” operator. It is pointed out that one possible 
definition of “best” involves the assignment of a certain 
quantity as the error of performance of an operator, 
after which a particular operator is chosen from admis- 
sible operators in such a way that the error produced by 
the particular operator is as small as possible. The con- 
cept is applied in the ensuing example, where the differ- 
ence between two functions F and g is to be minimized. 
It is then required that the following integral be a mini- 


mum. 


lim =— “TE — g(t) |?de. (4) 
T+ =? 


Therefore, an integral is established as a measure of the 
error, and the system which causes this integral to be a 
minimum is called the “best” system. 

The first application of the specific use of an integral 
as a measure of the error of a servo is found in the paper 
by Hall [1]. The actual error of a system is defined by 
Hall as the difference between the input and output of 
the system, 


e(t) = rd) — c(d), (5) 


where e(f) is the error, r(t) is the input and c(t) is the 
output. Fig. 2 shows this relationship graphically, for a 
step input. Eq. (5) describes a function which serves as 
a statement of system error. However, as pointed out 
above, a function cannot readily serve as a metric, since 
it is not a number, but a collection of numbers. Further- 
more, a function does not have certain properties which 
characterize a metric, namely: 
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Fig. 2—Step input, output, and error. 


1) that it is always positive or zero, 

2) that it is zero if and only if the distance it repre- 
sents is zero, 

3) that it is a numeric. 


The metric proposed by Hall is defined by 
ie f e(t)dl, (6) 
0 


the integral of square of error (ISE). An inspection of 
(6) shows that it does have the three properties of a 
metric, in that it is a numeric, it can take on only posi- 
tive values or the value zero, and it is zero if and only if 
e(t) is identically zero. 

One limitation of this metric, as applied to servos, is 
immediately apparent. The error, as given by (5), must 
be such that 

lim e(¢) = 0, (7) 

2a 
or the integral loses its meaning, unless the integral is 
truncated. This of course means that only systems which 
have zero steady-state error can be considered. An- 
other difficulty, which is borne out by experience in 
applying the metric, is that it will not always lead to a 
practical system (see [64]). On the other hand, it is 
easily adapted to direct measurement by means of 
ordinary instruments, since many standard measuring 
devices give a direct reading that is proportional to the 
square of the input. Another feature is the mathemati- 
cal convenience of squared error, since the integral of 
the squared error (ISE) often leads to forms that are well 
suited for computional purposes. This simple fact has 
often led to the use of criteria based on the square of 
error even though the use of other metrics would have 
led to more useful criteria. It was only after many such 
applications of the use of error squared measure that 
mathematical justification for the use of this convenient 
measure appeared [4|-[6]. These authors have shown 
that for a Gaussian stationary random input, the same 
“optimum” filter is obtained for any error measure 
chosen from a class of symmetrical functions. 
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Another quantity which has been proposed as a 
measure of error is the integral of error, 


7 f " elt)db. (8) 


This is a more explicit form of the “deviation area” con- 
cept discussed by Obradovic, and mentioned above. It 
has also been discussed by Oldenbourg and Sartorious 
[7], Mack [8], Stout [9], and briefly by Laning and 
Battin [10]. This particular measure does not satisfy 
completely the properties of a metric, since this integral 
does not necessarily have to be positive. It may also be 
zero, even though the error itself is not zero. Neverthe- 
less, in some cases, it may be considered to be a metric, 
and it has been used to describe system performance. It 
does also have the advantage, as the integral of square- 
of-error has, that standard instruments exist to enable 
direct measurements of the value of the integral. It is 
pointed out by Stout [9] that in certain cases the inte- 
gral is very simply evaluated, in the following manner. 
If r(t) is a unit step, and if the Laplace transform of the 
ratio of output to input can be expressed by 


C(s) = (ris + 1)(ros + 1) - > + (tms + 1) 
mee Pall). (Tos Al) 


(9) 


then the value of the integral, called the “control area,” 


1S 
p= [ e(t)dt 
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The proof is readily obtained by the use of the Laplace 
transform and the associated final-value theorem. 
Therefore, in cases where applicable, the integral of 
error is a very convenient measure to use. 

Ina paper by Nims [11] a discussion of “control area” 
is presented, which is illustrated in Fig. 3. Nims dis- 
cusses a disadvantage of the use of control area as a 


(a) (c) 


(b) (d) 


Fig. 3—Control area and weighted control area. (a)—(c) 
Control area. (d) Weighted control area. 
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measure of error. This disadvantage is that a system 
which has an oscillatory response has both positive and 
negative control area. The negative area therefore sub- 
tracts from the final value of the integral, which causes 
the integral to yield a value that is not truly descriptive 
of the over-all error. Nims therefore proposed a 
“weighted control area,” as described by 


i f wou. 


This integral is illustrated in Fig. 3(c) and 3(d). An ad- 
vantage of the use of the weighting function is that the 
large initial error (for step inputs) does not give rise to 
such a large contribution to the value of the integral. 
This consequence of the use of a weighting function is a 
desirable one, since the initial error in an ordinary servo 
is due to the inertia of the system, and hence, largely 
unavoidable. Therefore, a metric which is relatively in- 
sensitive to the initial error is of interest. 

The integral of the absolute value of the error has 
been proposed as a measure of system error. This inte- 


gral, 
b= { | e(¢) | dt, 


has been used in connection with analog computer solu- 
tions of servo problems by Fickeisen and Stout [12] and 
also by Caldwell and Rideout [13]. It is interesting to 
note that this metric first appeared in connection with 
analog studies. This is not surprising however, since it 
is one of the simplest of all metrics to use with analog 
computers, though usually difficult to deal with analyti- 
cally. This metric is also discussed by Laning and Bat- 
tin [10]. 

A paper by Graham and Lathrop [14] created a great 
deal of interest. Their paper presents as a metric the 
integral of time multiplied by absolute error (ITAE). 


It is defined as 
E ={ t| e(t) | dt. 
0 


As in (11), the time weighting serves to reduce the con- 
tribution of the large initial error to the value of the 
integral, as well as to place an emphasis on “late” errors. 
Another important feature of the Graham and Lathrop 
paper is the detailed discussion and presentation of re- 
sults of a comparison of the various metrics with the 
ITAE metric. For example, it is shown that the ITAE 
alone has the selectivity needed for a good metric; that 
is, a minimum value of the integral is readily discerni- 
ble, as system parameters are varied. The other metrics, 
integral of error, integral of absolute error, and integral 
of error squared, do not have this same property of se- 
lectivity, especially for higher-order systems. In addi- 
tion to the comparison with the known metrics, men- 
tioned above, results of a study of other measures, i.e., 
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E = te? (1) dt, (15) 
E =f e(t) | dt, (16) 


are given. These metrics have a selectivity which is de- 
sirable, but are given no further consideration because 
of the increased difficulty in handling them, either an- 
alytically or on an analog computer. The conclusion 
drawn from the Graham-Lathrop paper is therefore as 
follows: the integral of ITAE is a superior metric to use 
as a basis for a criterion because of its selectivity and 
relative ease of calculation. As a summary of results, 
tables of standard forms are given for the ITAE, as 
compared with the binomial standard forms and the 
Butterworth standard forms. Companions of these 
tables are the corresponding transient response curves, 
for step input. In closing the discussion of this paper, it 
might be remarked that certain nonlinear systems are 
also “optimized” by use of the ITAE. 
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sults. This philosophy is reflected in the following re- 
marks: 
... The ultimate decision of what constitutes good performance 
is based on human judgment or even personal opinion .. . the 
end result is in the nature of a hit or a miss. . . . It is not possible 


in a general way, to legislate for all cases, and the field must be 
narrowed. 


It is interesting to note that the concept of moments- 
of-error-squared can also be used to describe two other 
metrics discussed earlier. Eq. (6), the integral of error 
squared, can be said to be the zeroth moment of error- 
squared. Eq. (14) is the first moment of error-squared, 
while (15) is the second moment of error-squared. 

Wescott also speaks of “special penalty cases,” where 
“catastrophe” results if, for example, more than 10 per 
cent overshoot occurs. Such cases are not considered in 
his paper. 

One approach to the problem of considering special 
penalty cases is suggested by Whiteley [16]. A table of 
coefficient values of “standard forms” for optimum 
systems based simply on a maximum amount of over- 
shoot is presented. These coefficients are listed in Table 
I. The table shows, for example, that the parameter for 
a second-order, “class A” system, should be equal to 1.4. 


TABLE I 
WHITELEY’S STANDARD FORMS 


aes 8 Maximum 
Class xs Q=— Basis Per cent Coefficients 
System 6; Overshoot 
A wo” Q=1 for frequencies | 5 per cent 1 1.4 1 
Zero Displace- up to ffi, where 8 per cent 1 2 2 1 
ment Error p™+aipr t+ «+ - +0” 0.80 10 per cent 1 2.6 3.4 Delo 1 
= 
Qa 
B 2p +e” Maximum overshoot | 10 per cent i! 205 1 
Zero Velocity of 10 per cent, and no | 10 per cent 1 Bail 6.3 1 
Error prt +++ 2p+eo" subsequent under- 10 per cent 1 he? 16 12 1 
shoot 10 per cent 1 9 29 38 18 fi 
10 per cent 1 11 43 83 13s DS 1 
2+2 p+ a9” Maximum overshoot { 10 per cent 1 6.7 6.7 1 
Zero Accelera- as Wad as given, with one | 15 per cent , 1 4 fad ee 1'5 a 7.9 a 1 ; 
i mtoses 212+ "| small undershoot 20 per cent 
pee ot Ege ti aLee 20 percent |! “1 36" S25 PP ass i251 36 1 


About the same time that the Graham and Lathrop 
paper appeared, a paper concerning another integral 
form was presented by Wescott [15] in England. This 
integral, called the “moment-of-error-squared” is 


ee i te2(t)dl. 
0 


The criterion based on this metric is called the “mini- 
mum-moment-of-error-squared criterion.” Comparisons 
are made with the integral-of-error-squared: criterion, 
and cases where the weighted integral has the advantage 
over the unweighted integral are pointed out. On the 
other hand, for some cases Wescott’s measure leads to 
the same difficulty as the ISE in giving impractical re- 


(17) 


The transient response for a step input will then be 
such that the maximum overshoot is less than five per 
cent. Thus, the special case of specifying a maximum 
amount of overshoot is an early attempt to legislate 
against the “catastrophe” cases. Standard forms for the 
ITAE measure have also been given by Graham and 
Lathrop [14]. 

In their book on servomechanisms, James, Nichols 
and Phillips [17] discuss in some detail the minimiza- 
tion procedures of Wiener, as based on the root-mean- 
square measure. Some attention is also given in this book 
to the work of Hall and the ISE. It is pointed out that 
Hall’s method is a convenient mathematical tool and 
should therefore be used whenever applicable. It is also 
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pointed out that certain disadvantages exist (as men- 
tioned above), and that consequently other error- 
weighting devices might be employed. An illustration is 
given of an error vs weight-of-error curve (see Fig. 4.) 

In a discussion of control system design techniques, 
Truxal [18] describes the minimization process in de- 
tail. In presenting some disadvantages of the integral 
of square of error as a metric, the use of “error vs im- 
portance-of-error” curves is suggested. For example, if 
the system error is small, motor torque should be small; 
or if system error is large, full torque should be applied. 
This type of error vs importance-of-error curve is illus- 
trated in Fig. 5. 
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Fig. 4—Weight-of-error curve of James, Nichols, and Phillips. 
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Fig. 5—Truxal’s importance-of-error curve. 


Gibson [19] has presented a paper which summarizes 
a number of methods of evaluating system performance. 
In this paper, a simple control system is analyzed by 
the several methods, including the characteristic plots 
of Nyquist, Bode, and the Evans root-locus. In addi- 
tion, an integral metric is employed and examined, the 
ITAE of Graham and Lathrop. A table summarizes the 
results of applying each of the methods, by showing 
what information about system performance is obtained 
from each method. 

A generalization and extension of the type of measures 
discussed thus far was presented in a previous paper 
[20]. This form provides a versatile measure for servo 
performance, one that can be adapted to fit the many 
situations that arise in servo problems. Eq. (18) states 
the generalization 


E = Flew, dat (18) 
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The versatility of this form of error measure is inherent 
in the interpretation and formation of the / functions, 
which can be either functions of magnitude of error 
alone, Fle(t)|, or functions of magnitude and time- 
weighting functions. For example, F functions could 
be chosen as any of the forms discussed earlier, such as 
e(t), e2(t), |e(t)|, t]e(é)|, and #e2(2). 

If a geometrical interpretation is made for the F func- 
tions, a great deal of insight can be gained for adapting 
(18) to special cases, particularly for “catastrophe” 
cases. An illustration for F[e(#), t]=|e(2)| is shown in 
Fig. 6. Upon observing the F-function characteristics, 
it is noted that for positive inputs, the left quadrant 
represents overshoot-error weighting, while the right 
quadrant represents undershoot-error weighting. This 
interpretation opens the way to anti-overshoot meas- 
ures, as illustrated in Figs. 7 and 8. If a certain small 
amplitude of error is permissible (even in the steady 
state) an F function of the type shown in Fig. 9 could 
be used. It is apparent that almost an infinity of F 
functions could be constructed, to be applied to special 
solutions. The optimum step responses, relative to the 
F functions discussed in this paragraph, are shown in 
Fig. 10. 

Thus far all discussion has centered on a definition 
of error given as input minus output [see (5) ]. It is 
possible to extend this definition of error to include a 
more general interpretation of error. Thus a model error 
or model-system error may be defined. The basis for 
this extension is shown in Fig. 11. If the “model” is con- 
sidered to have a unity transfer function, the error is the 
same as that described in (5). The basis for a more com- 
plex interpretation of system error is provided by choos- 
ing a “desired transfer function” for the model and com- 
paring its output with the actual system output. This 
scheme is discussed in a number of papers, in connec- 
tion with adaptive control system design. 

Performance measures of a form somewhat different 
from those discussed above can be derived if the “model” 
of Fig. 11 is a pure delay. System error is then the delay- 
error, discussed by the authors in a previous paper [21 ]. 
Delay-error for a step input is illustrated in Fig. 12. 

Integrals of this different form have been discussed 
by a number of authors. For example, a measure of 
amplifier distortion was described by Aigrain and Wil- 
liams [22]. This integral, called the “transient distor- 
tion,” is defined as 


r= icc — fils — Ts) Pat, (19) 


where fi(t) is a step function input, fo(¢) is the amplifier 
transient output and fi\(t—7») is the input delayed by 
an amount 7’). The paper is devoted mainly to a method 
of evaluating the integral, and the application is limited 
to the study of amplifiers. 
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Fig. 6—Integral of absolute error metric. 
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Fig. 10—Optimum response to step for various measures. 
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Fig. 12—Delay error. 


Another proposal of an integral of this form has been 
made by Lee and Wiesner [23]. In their discussion of 
the application of correlation functions in determining 
an optimum linear system, the following error expres- 
sion is introduced: 


th 
« = lim tee [fo(t) — f(t — a) |2dt, (20) 
Morea Duk = 

where f(t) is the system output and f,,(t) is the desired 
filter output. A delay a is permitted in the expression of 
the output. Consequently, correlation functions are 
introduced, as an expansion and examination of (20) 
shows. 

More recently, Spooner and Rideout [24] discussed 
this form of error measure, for systems having station- 
ary random inputs. They have called this function the 
generalized error function (GEF). This function is de- 
fined as 

T 


GEF = E(r) = lim Aid [r(¢ — r) — c(t) ?dt. (21) 
T T: 


so LI —T 
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In a study that closely followed this work, the authors 
[21] considered a similar form, but for transient inputs. 
This form is given by 


co 


E(r) -{ [r(é — r) — c(t) |2dt. 


== 00) 


(22) 


An interesting comparison of (21) and (22) can be 

made [24]. An expansion of (21) results in 

E(t) = $11(0) + $22(0) — 2¢12(7) (23) 
for the random input signal case. The @’s are input, out- 
put, and cross-correlation functions. For the transient 
input signal case, 

E(t) = ¥i(0) + W22(0) — 2prio(7). (24) 
The y’s are the input, output, and cross-translation 
functions. (Translation functions were introduced by 
Newton [25].) The process of measuring translation 
functions on an analog computer is simpler than that of 
measuring correlation functions, since this type of 
transient signal is the response to a step input, which 
can easily be delayed without a delay line. Thus, the 
analysis by use of this transient analog provides a 
means of simplified mechanization, when it can be ap- 
plied. 

An illustration is given in Fig. 13. The upper system 
represents a linear network Ly with a random signal 
input 7,(¢). This input can be considered to be the out- 
put of a linear filter L1, which has a white noise input. 
Associated with this system are the input- and output- 
auto-correlation functions, and the respective power 
spectral densities. £,(r) for this system is given by (23). 
Fig. 7(b) shows the transient analog of the random- 
input case. For this system, the input is 7;(¢), the im- 
pulse response of a particular linear filter. Associated 
with this system are the input- and output-auto-trans- 
lation functions, and the respective energy spectral 
densities. E;(r) for this system is given by (24). For the 
case of a linear Lz network, /,(r) and E:(r) are numer- 
ically equivalent, provided that 7,(t) satisfies 


1 2) 
(Olen f Pii* (jw) e/* ‘des, (25) 
Lit) as 


where ®1;( jw) =®1,+( jw) Pi (jw), and ®y+(jw) has only 
upper-half plane poles. For an illustrative example, 
consider 


Bu(jo) = (26) 
then 
11+ (jw) = eel 
1+) 
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Thus, the linear system Lz having the input signal with 
the power spectrum of (26) can be represented on an 
analog computer by the transient analog having an 
input 7,(¢) given by (27). The inter-relationships among 
these various quantities are summarized [26] in Fig. 14. 

Performance measures “past” may be appropriately 
summarized by the forms shown in (18). The early per- 
formance measures, such as integral of error squared 
and integral of absolute error, are included in these 
forms, as are the time-weighted forms. In addition, 
there is provided a means for treating certain specialized 
performance characteristics. To a great extent, all these 
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Fig. 13—Transient analog for random signal case. 
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Fig. 14—Interrelationships of system characteristics. 
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forms have been used only for step inputs. It is also ap- 
parent that these forms are based more on intuitive than 
on mathematical concepts. Nevertheless, the develop- 
ment of these forms represents a significant step in the 
evolution of performance measures. 


I]. PERFORMANCE MEASURES: PRESENT 


For the purposes of discussion in this section, the 
“present” will be somewhat loosely interpreted as in- 
cluding the past year or two. During this period, the 
subject of performance measure in control system de- 
sign has received increased emphasis in two areas: 


1) the evaluation of control systems, where perform- 
ance measures receive the emphasis once given to 
stability study, 

2) the use of performance measuring devices as essen- 
tial integral parts of self-adaptive control systems. 


Approaches to the performance measure problem in- 
clude the following two major areas of mathematical 
theory: 


1) statistical and probabilistic methods, originated 
by Wiener, 

2) methods based on the calculus of variations and 
extensions of this theory by Bellman (dynamic 
programming). 


Statistical and Probabilistic Concepts 


Wiener’s original work has been extended by others 
[27 |-[33] but in general an estimate of the mean square 
error has been used as a performance measure. Kaufman 
[34] concerned himself with system optimization based 
on other than estimates of mean-square error, in linear 
systems with stationary (but not necessarily Gaussian) 

inputs. In particular, he has suggested measures of the 
form 


E = coe” + cre* + cee® (28) 


for cases where the mean square alone is not sufficiently 
meaningful. For those cases where the input and dis- 
turbances are independent and each is symmetrical, he 
shows how to evaluate and minimize £ analytically by 
use of approximations for the correlation functions 
which occur in the integrands. 

A performance measure based on a probabilistic error 
has been proposed and described by Zaborszky and 
Diesel. This measure is defined as follows: 


b= { F[(e(t), t, 1, °° * 5% 
0 


plas, (29) 


where 


e(¢) =system error, 
t=time, 
v;=system parameters, 
- p= probability distribution of the times at which 
the output is utilized. 
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Although the paper introduces some ambitious ob- 
jectives and advances claims of broader usefulness and 
greater physical meaning for this measure than for 
existing criteria, substantiation of these claims is not 
eeu In particular, reference is made to the need 
for “engineering judgment” in selecting a specific F(e) 
function, and also to exclusive use of the commonly 
used F(e) =e?. 

Thus, (29) becomes in reality 


r= [ epiod 


Eq. (30) therefore represents the main theme of the 
proposed probabilistic measure, a form which is cer- 
tainly contained in the class of measures defined by 
(18). It is also apparent that the p(t) factor in (29) is in 
a sense redundant, since any form of measure that can 
be obtained from (29) can also be derived from (18). 

Subsequent papers [65], [66] of these authors further 
emphasize the attention placed on the time-weighting 
function p(t), without regard to the consideration of 
choice of the amplitude-weighting function F(e). For 
cases where the use of (30) is purposeful, advantages 
can be gained by pre-programmed computer solutions 
for evaluation purposes, if the use of a large-scale digital 
computer is justified. 

Some early applications of the use of correlation func- 
tions in performance measures were discussed earlier in 
this paper [23], [24]. Additional schemes are now sum- 
marized. 

Reswick [37] discusses methods which make use of auto- 
and cross-correlation functions and provide means 
whereby the system impulse response can be obtained 
during system operation. A special device, called the 
delay-line-synthesizer (DLS), is used for impulse re- 
sponse determination. This device approximates the de- 
convolution process; 7.e., h(t) is obtained from the de- 
convolution of the integral 


(30) 


re(T) ay “nada a u)du, 


0 


(31) 


since for white noise system input, ¢,,(7) is an impulse 
and ¢,-(r) becomes equal to the impulse response. 

Another basic application of correlation techniques 

is introduced by Anderson, e¢ al. [38], where a figure of 
merit called the impulse response area ratio (IRAR) is 
used. This performance measure is a key element of an 
adaptive control system discussed in the paper. Aseltine 
has proposed a definition of adaptive control in which a 
performance measure has an important role [39]. This 
definition consists of the following three elements: 

1) continuous measurement of system dynamic per- 
formance, while the system is operating, 

2) means of converting this measure of performance 
into a number that describes how good the per- 
formance is, 

3) readjustment of system control parameters on the 
basis of 1) and 2). 
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Although differences of opinion may exist on the ques- 
tion of what does or what does not constitute an adap- 
tive system, the above viewpoint that a performance 
measure vitally affects the operation and design of the 
(adaptive) control system is widely accepted. 

The method of measuring the system performance 
adopted in the Anderson paper is one that is attributed 
to Lee [40] and is the one also used by Reswick. The 
method of evaluating the system performance de- 
parts from the usual case of minimizing or maximizing 
some kind of integral. Instead, a performance measure 
is selected that has the value zero for “optimum” condi- 
tions, and positive or negative values for departure 
from the optimum conditions. The measure is based on 
the damping ratio or relative stability of the system. 
The figure of merit F is differentiated with respect to 
the variable to be adjusted in the system transfer func- 
tion, to obtain the expression for the “gain” of the adap- 
tive loop. An extension of this concept is presented sub- 
sequently in this paper. 

Moments of the system impulse response have been 
shown to provide a means for determining system 
dynamic characteristics [41]. More recently, Goodman 
and Hillsley [42] have described a method for obtaining 
such moments continuously. 

The mth moment of the impulse response is defined by 


ee f "ph t)dl. (32) 


0 


A similar definition can be given for moments of the 
correlation function. For example, the mth moment of 
the cross-correlation function is defined by 


Ge -{ T"bre(T) dT. (33) 


Goodman and Hillsley have demonstrated a method for 
measuring the correlation function moments continu- 
ously on an analog computer. Thus, a means is provided 
for obtaining a measure related to impulse without 
actually measuring the impulse response. An extension 
of this concept is discussed subsequently in this paper. 


Variational Calculus Techniques 


An extension of the Wiener optimization technique 
using variational calculus was presented recently by 
Murphy and Bold [43]. In this discussion, an investiga- 
tion of a square-of-error criterion with an arbitrary 
weighting function is presented. Their error criterion is 


defined by 


T 


B= lim oo W (t)e?(t) dt, (34) 


T 0 = 


where e(t) is the system error and W(t) is a function of 
time. 
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The minimization procedure is a method for obtain- 
ing the optimum system transfer function for an arbi- 
trary W(t). This use of W(t) as a weighting function is 
more general than the performance measure of Zabors- 
zky-Diesel, as indicated in (30), since the restrictions on 
W(t) are not as great as those placed on the p(é). 

Dynamic programming is a relatively new functional 
equation technique introduced by Bellman [44]. The 
method extends the concepts of the calculus of varia- 
tions, enabling analytical treatment of a wider class of 
problems. In general, solutions obtained by this method 
are obtained numerically, through the use of high-speed 
digital computers [45]. 

The investigations of Bellman and Kalaba [45], [46] 
have been directed toward the laying of the mathemati- 
cal foundations of dynamic programming. Others [47 |- 
[49] have investigated the application of these tech- 
niques to adaptive system design problems. Merriam 
[49] points out that the dynamic programming method 
permits an error minimization algorithm to be de- 
veloped for an arbitrary error criterion. However, he 
goes on to a discussion of a computationally more prac- 
tical subclass in which a quadratic error measurement 
is used. 

In another approach to the problem of utilizing a 
general performance index, Kalman and Koepcke [50] 
have proposed a class of quadratic indices, as applied to 
continuous and sampled-data control systems, This 
form is defined by 


NT 
Iv= | [0s + ym**@]oa, 33) 
0 

valid for the time interval 0<t#<NT; Q and Z(é) are 
matrix representations of the state of the system, or a 
measure of the error at a time ft; m*(t)=m/(kt), a se- 
quence of numbers that describes the control signals of 
the system; y is a constant which weights the relative 
importance of minimization of errors, and the control 
energy associated with the m*(t) term; w(#) is a time- 
weighting function, which is used to indicate the im- 
portance of errors occurring at various instants of time. 
This performance index is more general than the one 
suggested in (31), since w(#) could be defined as a prob- 
ability density function, or as some other function of 
time, for example, w(t) =¢. Another interesting weight- 
ing function is the exponential function \* where X is 


some constant. Such a choice leads to performance in- 
dexes such as 


(36) 


eA =f leolwva, 


and 


Jos if [e2(¢) + ké2() JAtdt. (37) 
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It is pointed out by Kalman and Koepcke that certain 
difficulties evaluating system designs by use of these 
performance measures can be overcome by use of dy- 
namic programming techniques. 

A measure similar to (37) is described by Topitsyn 
[58] in a Russian paper. He discusses methods of opti- 
mization for a given maximum amount of overshoot. 


III. PERFORMANCE MEASURES: FUTURE 


The fact that performance measures are taking on in- 
creased importance in control-system design is evi- 
denced by the vast amount of material that has ap- 
peared on the subject in recent years. A significant 
sampling of the investigations which have been made is 
summarized in the first two sections of this paper. A 
trend that is clearly implied, and, in some cases, pointed 
out directly, is one of an increased emphasis on the use 
of statistical and probabilistic concepts. Inherent in 
these approaches are more direct procedures for arriving 
at optimum designs than were once possible. Particu- 
larly with the aid of computers, designers are free to 
use a wide variety of performance measures. A good 
example is seen in some of the applications of dynamic 
programming methods. 

A digression is in order at this point. In a sense, a 
motion has been made [51] and seconded [46] to re- 
evaluate what is meant by the term “optimum.” This 
follows rather naturally, as control systems become 
more sophisticated and design procedures rely more 
and more on improved mathematical processes and 
computation techniques. A certain amount of arbitrari- 
ness remains, however, in the choice which can now be 
made from a wide variety of performance measures. This 
choice is much like the engineer’s other design prob- 
lems. Faced with the need to build a control system to 
perform some function, he must base his system design 
on some composite performance measure, which is in- 
fluenced by considerations of cost, time and conven- 
ience, as well as by system performance. The need for an 
additional factor in a performance measure, that of 
reliability, is also becoming more apparent. The choice 
of the performance measure, by the engineer or his 
customer, is thus a second-order design problem and is 
based on some higher-order and more complex per- 
formance measure of the performance measure, as well 
as, again, on considerations of cost, time and conven- 
ience. Thus the ITAE measure, which is certainly con- 
venient, is used because it has been shown to give sys- 
tems whose response to an input step has little over- 
shoot and fast time-of-rise. Thus, notions regarding 
overshoot are used to govern choice of a criterion which 
does not directly measure overshoot. 

Another reason for choice of a criterion is to provide 
a simple means for comparison of quite different sys- 
tems. Here again, simplicity is important in choice of a 
performance measure. 


Schultz and Rideout: Control System Performance Measures: Past, Present, and Future 51 


In going from a consideration of control system errors 
with step function inputs to errors with random inputs, 
the effect of the choice of performance measure, and its 
subsequent minimization, on statistical properties of 
the error becomes important. An example is shown in 


Fig. 15, for f(e) =e”. The expected value of the function 
of error is 


Bye f flo pl flO} a(flo) 


-f ONO (38) 


Thus, the criterion output depends on the error proba- 
bility density p(e). 
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Fig. 15—Probability density curve and function of error curve. 


If the system input r(¢) is Gaussian, the output c(é), 
and thus the error e(¢), will also be Gaussian for a linear 
system. It has been shown [4|-[6] that within a wide 
class of functions the choice of f(€) does not really mat- 
ter, since the same optimum linear system results. 

Thus, in a self-adaptive system based on a linear 
system with Gaussian input, the distribution of the out- 
put of the system cannot be altered by parameter 
adaptation. Consequently, only the mean and mean- 
square can be reduced. 

However, if the input is not Gaussian, or if the system 
is nonlinear, the choice of the criterion curve will affect 
the system output probability distribution in addition 
to affecting the mean and mean-square. Thus, the idea 
of shaping the criterion-curve to provide the desired 
error-probability density curve, by adaptation or by 
hand, appears. 
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In applying this notion, it would seem desirable to 
measure some finite number of important moments, 
combine this information, and use it to control param- 
eters in such a way as to minimize some weighted aver- 
age of these moments. An example of such a process is 
shown in Fig. 16, where a symmetrical distribution of 
the error is assumed. Here estimates of &, & and ¢ are 
periodically assessed by a computer, and used to con- 
trol parameters a, 8 and y of a system, in an adaptive 
scheme. If a constant relative weighting of those mo- 
ments is required, a single F(e€) =ae?+be'+ce® may be 


used. 
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Fig. 16—Control of parameters by weighted 
average of moments of error. 


These ideas are applicable to the case where the de- 
lay-error r(¢—r) —c(t) or prediction-error r(t) —c(t—7) 
is of interest, rather than the ordinary error r(¢) —c(t), 
and mechanization of such error measurement merely 
requires the dead-time delay of the appropriate signal. 
In the existing body of theory that will be useful in de- 
veloping these probabilistic ideas are the works of 
Baum [52] and Axelby [33] and others. Baum dis- 
cusses limiter curves defined by the error integral, for 
Gaussian inputs. 


‘eee aa 
a if §* /2000dz. 
K V 2100s 0 


The shape of the output probability density function 
can be varied by adjusting oo, the rms value of the 
limiter curve. In particular, the output probability 
density curve can be made to be uniform, over the 
range +3K, if the rms value of the limiter curve equals 
the rms value of the input noise. 

Axelby [33] demonstrates the effect of noise trans- 
mission through nonlinear elements, such as saturation, 
dead zone, and “bang-bang.” The latter case is a limit- 
ing case of (40) for zero rms value of the limiter curve. 

Still [53] describes an analog simulation of a probabil- 
ity filter. The concept introduced in this work is one of 
giving small weighting to large errors of low probability 
~ of occurrence. Thus, only the errors of high probability 
of occurrence will affect the system. An example using 
a nonlinear probability filter illustrates the effectiveness 
of this scheme. 


y(x) = (39) 
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Applications in Adaptive System Simulation: Digital 


Extensions to the work of Goodman and Hillsley, and 
Aseltine, et al., are discussed in a current paper on an 
adaptive system simulation [54]. This investigation 
considers a multi-dimensional figure-of-merit. An as- 
sumption is made that a desired or “ideal” system dy- 
namic response can be characterized by a set of power 
moments of the system impulse response. A correspond- 
ing set of moments can be measured during system op- 
eration. Subtracting the desired moments provides a 
set of moment corrections, AH,, AH2, which are re- 
quired to make the actual system response correspond 
to the desired response, insofar as is possible through 
correspondence of the first 7 moments. The actual mo- 
ments are computed in terms of the system input-output 
cross-correlation, where the input is white noise. 

Since the moments are functions of the adjustment 
parameters, the total differential of the mth moment is 


OH, OH, 
dH, — NHS = Ax, + Ax2 
x1 0X2 
OH, 
+ WN ot (40) 
X3 


where the x; are the parameters of the system to be 
adjusted adaptively. The expression which forms the 
basis for simultaneous adjustment of all moments is the 
matrix expression 


[Az] = [4] [Ax], (41) 


where [AH] is a moment-correction column matrix, 
[Ax] is a parameter-change column matrix, and [A] is 
a matrix whose elements are defined by 


0H, (42) 
Anz =} . 
: Ox; 
The parameter-change increments are 
[4x] = [4] “[4g]. (43) 


An elaborate simulation on an IBM-704 was prepared 
for investigating this concept, and initial tests con- 
ducted with the simulation give evidence that the 
scheme is feasible. Further tests are currently planned, 
and are being made with the simulation. 

A diagram of the over-all system is shown in Fig. 17. 


Applications in Adaptive System Simulation: Analog 


In another current paper [55], an analog computer 
study of an adaptive control system is described. Error 
criteria are discussed in terms of a parameter-perturba- 
tion adaptive system. 

A block diagram of the system is shown in Fig. 18. 
In this system, if we can assume that the small param- 
eter-perturbation signal a, sin w, ¢ causes a linear modu- 
lation of the error, then 


e(2) = eo(t) [1 =F aymy sin wit}, (44) 
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Fig. 18—Analog system for a parameter- 
perturbation adaptive system. 


where €,(¢) is the error for a; =0, and my is the part of the 
modulation coefficient, the sign and size of which de- 
pend upon the misadjustment of the parameter a, for 
the conditions under which the system is operating. 

The use of an error-squaring device here gives an out- 
put 


e2(t) & e2(2)[1 + 2aym sin wit], (45) 


ignoring terms in a;?m,*. After multiplication by A sin 
wit and integration, 


1 Li 
a= sab €0°(c) [sin wyo + aym, — aym, COS 2u10|do. (46) 
0 


The second term in brackets gives the desired output, 
and this part of the return signal in the adaptive loop, if 
the loop time-constant is 7’, may be approximated by 


ay = €o°(L)aymy T/T. (47) 

Thus the loop gain depends upon the mean square 
error €)”, as well as the modulation term, m. Thus, any 
large changes in error amplitude must be countered by 
either some kind of gain control, or by a limiter just 
ahead of the integrator. 

One advantage of the scheme of Fig. 18 is that it per- 
mits the output of the squarer to be either integrated, or 
filtered to yield E, an estimate of the mean square error. 

The feedback signal is dependent for sign and for 
size, as well, if limiting is not used, upon the modula- 
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tion m, and this, in turn, will depend in general upon 
the function F. In the case of Gaussian input and a 
linear system, however, we can use any symmetrical 
function for F and the system will arrive at the same 
final value, since adaptation can only reduce r. One 
choice for F in the linear system-Gaussian input case is 
a logarithmic criterion, with a modification to avoid 
negative values. As shown in Fig. 19, this is 


F(e) = log {1+ | «| } 
=log{i+ k | ey | [1 + mai sin wt]} 
k| ¢o| 
1+ k| e0| 


This function tends to give instantaneous limiting, in 
effect, because the term in sin @¢ is independent of 
error amplitude, if R| €o| >1. 


= log [1+ | «| | 4 (48) 
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Fig. 19—Approximation to a logarithmic criterion curve. 


However, this scheme makes desirable, for example, a 
separate squarer and filter, if it is desirable that the 
mean square error be conveniently monitored; and this 
becomes essential if the input is not Gaussian, or if the 
system is nonlinear. Unfortunately, it is in just such 
cases that the shape of the function F becomes im- 
portant, because the modulation coefficient m, will be 
determined by the interrelationship between the prob- 
ability density of the error and the function /. Here we 
are faced with a choice between shaping F to give in- 
stantaneous limiting, and shaping it to give some 
weighted minimum of the moments of ¢. The latter 
may be desirable, and then other control of the gain of 
the adaptive loop may be desirable. 

Investigations to extend both types of simulation 
described above are currently underway. Among the 
topics to be studied in both cases is the effect of the 
choice of the performance measure in the adaptive sys- 
tem. It is expected that further application of probabil- 
istic concepts will be studied, especially in regard to 
probability-density-shaping techniques. 


IV. CONCLUSION 


Trends in the applications of performance measures 
have indicated the increased use of sophisticated math- 
ematical concepts. Of particular importance is the use 
of statistical methods, in order that intuitive concepts 
can be aided or replaced by concepts that are more 
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mathematical in nature. Dynamic programming tech- 
niques and the application of correlation and translation 
functions are other methods that are becoming more 
important. 

The application of performance measures to adaptive 
systems increases the difficulty of choosing a perform- 
ance measure. We must consciously think about meas- 
uring the performance of the chosen performance meas- 
ure, and perhaps even consider mechanizing this second- 
order measure. For example, if an adaptive control sys- 
tem with random inputs is subject to step-changes in a 
parameter, we may wish to have the adaptively con- 
trolled parameters assume their new values rapidly and 
without overshoot. An ITAE measure might be applied 
to the ensemble average of f(€) as a function of time after 
the step change, to assist in the choice of the function 
f(e) used in the adaptive loops. Such ideas and their 
mechanization may be extended to any practical limit. 

All of this may seem discouraging to anyone seeking 
definite answers on performance measures. [t seems ap- 
parent that there is no one magic formula, but that 
rather we are faced with a problem which is basically 
unanswerable. Nevertheless, engineers must choose per- 
formance measures, striving on the one hand to keep 
intuitive procedures from smothering the growth of 
more solidly based principles of measurement, and yet 
attempting to keep mathematical complexity from hid- 
ing simple meanings. 
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A Simulator Study of a ‘T'wo-Parameter 


Adaptive System’ 
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Summary—The use of sinusoidal parameter perturbation ap- 
plied to a feedback control system to obtain an adaptive scheme 
which optimizes the system for changes in inputs and/or system 
parameters is discussed. It is shown that if a parameter pertur- 
bation signal is cross-correlated with the system error squared, the 
correlator output can be used to adjust the parameter to minimize 
the mean-square error. Other error measures may also be used. Two 
or more parameters may be simultaneously adjusted if they are 
perturbed at different frequencies, and each provided with an inde- 
pendent adaptive loop. A computer simulation of a third-order system 
having two adjustable parameters was examined for a variety of in- 


_ puts including random signals. It is shown that the scheme minimizes 


the mean-square error in all cases. 
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I. INTRODUCTION 
Stone such as feedback control devices may be 


designed to give responses which are optimum in 
some sense (e.g., minimum mean-square error) for 
a variety of different input signals, each occurring with 
known probability. Better results will be obtained if 
those parameters in the system which can be varied are 
so adjusted as to optimize the output for each class of 
input signal. This may be done by preprogramming if 
the class of signals to be expected at any given time is 
known. If this information is not available then a “sig- 
nal-adaptive” system may be set up, which analyzes or 
“identifies” the input signal and automatically opti- 
mizes the system as the input signal statistics change. 
Of course there may be more than one input signal, and 
some of these may be disturbances rather than com- 
mands. 
Another problem results if any of the parameters of 
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the system change with time. If this change cannot be 
countered by preprogrammed changes in the system, 
then a control loop may be desirable to change the ad- 
justable parameters of the system so that the output is 
optimized according to some chosen criterion. Such a 
system may be said to be “system-adaptive.” 

The study described in this paper is one which uses a 
scheme of parameter perturbation and correlation de- 
tection in feedback loops, resulting in a self-adaptive 
feature. Quasi-stationary random inputs, whose statis- 
tics change slowly compared to periods of at least their 
most important spectral content, and similarly slow 
random variations in system parameter values were 
assumed, although step changes were convenient for 
many simulator studies. The system is applicable to 
either analog or digital methods of control. 

This scheme for adaptation was first mentioned by 
Draper and Li [1]-[3]. The studies of the optimization 
of process control systems carried out in early studies by 
Box [4] are related to this work, except that, in the sys- 
tems he describes, a human is used to close the adaptive 
loop. Widrow [5] has described an adaptive sampled- 
data system using step changes. Bibliographies by Asel- 
tine, et al. [2], and Stormer [6] cover a number of types 
of adaptive systems. 


Il. SystEM DESCRIPTION 


The adaptive system, as shown for the single param- 
eter case in Fig. 1, consists of a parameter controller, 
error function device, filter, integrator, and multiplier, 
all connected to the system in what might be called a 
parametric feedback loop. A small sinusoidal perturba- 
tion is applied to the parameter a, which is to be con- 
trolled. The frequency o; of the perturbation may be 
intermediate between the frequencies in the error spec- 
trum (ignoring its nonstationarity) and the low frequen- 
cies in system parameter disturbances or in signal sta- 
tistics changes. 

The error function device of Fig. 1 gives some non- 
negative zero-memory function of the error. It might, 
for example, be the error squared, 


F(e) = e. (1) 


We are concerned with the first moment of €?, which 
may be estimated by time integration. Ignoring, ini- 
tially, the uncertainty in such a measurement (due to 
finite time of integration, and low-frequency nonsta- 
tionarity) 


B= Fle) ~ =f Feu, T large. (2) 


This quantity, which is a measure of error, is a 
metric and may be regarded as a function of the input 
statistics and of the variable system parameters. If only 
one parameter a@ is varied, and /(qa) tends to be a para- 
bolic function of a as shown in Fig. 2, then it can be 
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Fig. 1—Parameter perturbation adaptive system in block form. 
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Fig. 2—Average of an error function E(a@), as one 
parameter a is varied. 


seen that in the stationary case the output at frequency 
«; will tend to be of one phase if @ is below its optimum 
value, and of opposite phase if it is above (cases 1 and 2 
in Fig. 2). If ais at the value a, which minimizes E(q) 
there will be no output at frequency @. 

The correlation detector, or phase-sensitive detector, 
made up of a multiplier and integrator combines the 
perturbation signal and the filtered error measure to 
give a signal which will cause a to approach a». Of 
course changes in input statistics, or changes in other 
parameters, may change the position*and shape of the 
curve of F(a) in Fig. 2, but the system will continually 
try to seek that value of a, corresponding to the 
instantaneous minimum of this curve. 

If more than one parameter of the system is to be 
controlled, then a separate loop must be set up for each 
parameter using different perturbation frequencies. The 
same error measure may be used for each loop if this is 
appropriate, but other elements must be duplicated for 
each parameter, It is not essential that the error be an 
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F g. 3—Contours of equal error-function average E(a, 8) 
for the two-parameter case. 
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Fig: 4—Spectra in a parameter-perturbation adaptive system with 
sinusoidal input. (a) Spectrum of error. (b) Spectrum of error 
squared. (c) Spectrum of multiplier output, y=e sin art. 


orthogonal function of the parameters. Fig. 3 shows a 
realistic set of contours for a two-parameter case. 

It is desirable that there be a single minimum in the 
error measure, viewed as a function of the adjustable 
parameters. This is not the general case, although a 
single minimum is often likely over the important 
ranges of parameter values even for large numbers of 
parameters [7]. If multiple minima are troublesome, 
an auxiliary model technique could be used to find an 
absolute minimum. 


III. ANALYSIS OF THE ADAPTIVE Loop— 
SINUSOIDAL INPUT CASE 


Consider first the case in which a single adaptive loop 
is to be added to a linear system to minimize the average 
of some function of the error by adjustment of a param- 
eter a. If the adaptive loop (Fig. 1) is opened at the 
integrator output, and a has the initial value a, then 
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with a perturbation of some small amplitude a, 
(3) 
The instantaneous error may be assumed to be modu- 


lated by this perturbation, 


e(t) = [1 + am sin wit] eo(2) 


a = a + ay sin writ. 


(4) 
where €o() is the error for @=a) in the absence of modu- 


lation, and the degree of modulation, a,m, is small. 
For the sinusoidal input case, 


ri) = _R sinew, (5) 
where w is, typically, a higher frequency than the per- 
turbation frequency w. Now the error with no modula- 
tion will be of the form 


€o(t) — ko R sin (wt + $0) (6) 


because of linearity. We will ignore ¢o, or assume it zero, 
since it is unimportant in the analysis which follows. 
The modulated error is 


e(t) = RoRU + aym sin wf) sin wl. (7) 


Although it is interesting and important to consider 
many error criteria, we will take the way of greatest 
mathematical ease and consider first the mean-square 
error criterion. The square of (7), after multiplication 
by A, sin at, gives the integrator input, y, (Fig. 1). 

ko? R?a1:m,A 


y + sinusoidal terms, 


: (8) 


ifw1 < 2w/3. 


Fig. 4 shows the spectra for ¢, e?, and y for the sinu- 
soidal input case. 

A long integration of y will tend to make all oscilla- 
tory terms in (8) insignificant in comparison with the 
constant first term. 

Assume a parabolic form for the mean-square error, 


eo? = R°>[P + Q(ao — am)?], (9) 


such that €)? has a minimum value R2P at ajp=a,,. It can 
be shown that the modulation index is now 


_ 20(av - 


Qm) 
Ti : ‘ 
Ro? 


(10) 


Substitution of this value for the modulation coeffi- 
cient m, into the nonsinusoidal first term in (8) yields 


Vie R’a,A1O(ao ed ero (11) 


Thus, for the assumed parabolic mean-square error 
curve, the dc part of the signal applied to the integrator 
is proportional to the difference, (a)—a,,), between the 
actual value of the parameter a, and a,, the value 
which makes ¢,2 a minimum. 

Also, it is to be noted that y; in (11) is proportional 
to the derivative of €2 with respect to a; from (9), 

de? 

Ser = 2R?0(a0 — am). 


ao 


(12) 
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Therefore, 


dey” 


Votmae Is 


a (43) 


In general, for any error measure E and any number 
of parameters, the parabola which fits # in an a-plane 
near Qp will give 


ACEI SO ) 
yo= Kk ) 


Jao 


(14) 


although K will tend to be a function of a for nonpara- 
bolic curves. 

Some information of importance regarding the adap- 
tive loop may be deduced from (12). Of most im- 
portance is the presence of the term (a@)—Qm) indicat- 
ing that the system plus squarer and correlating multi- 
plier is equivalent to a subtraction circuit yielding the 
error in the parameter a with respect to its optimum 
value. It can be seen that y will have the same form if 
Qm is changed to a new value either because the fre- 
quency of the input or the value of some other param- 
eter has been changed. In these cases Q may also change, 
thus changing the gain of the adaptive loop. A more 
serious change in gain appears if the input r(t) changes 
level, for y varies as R? varies. This is undesirable be- 
cause of possible instability. The open loop gain of the 
adaptive loop is approximated by 


Ra, A 10 


OT (15) 


Y(p) = 


from (11) and Fig. 1, where 7 is the integrator time con- 
stant. This approximate form indicates stability for all 
values of R, but neglected poles may lead to instability 
as R increases. This difficulty may be overcome by: 


1)- use of automatic gain control in the adaptive loop, 

2) use of a limiter ahead of the integrator, 

3) use of a criterion [12] other than mean square 
which serves as an instantaneous limiter. 


IV. ANALYSIS OF THE ADAPTIVE Loop 
—RAnNbDom INPUTS 


Suppose that the system which is to be made self- 
adaptive is a linear servomechanism with a random 
input such that the error spectrum tends to be concen- 
trated at the higher frequencies contained in the input 
spectrum. In such cases it was felt that the perturbation 
frequencies should be as high as possible, but below the 
main part of the error spectrum. 

It might be thought that in such a system, adaptive 
loop response time would be primarily governed by the 
length of a perturbation period. It is easy to show that 
this is not the only consideration for the random input 
case by considering the effect of a square-wave pertur- 
bation of period 7, for the Gaussian input case. If the 
loop is opened at the integrator output, the normalized 
variance of this output at the end of the first half-cycle 
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may be approximated [9] by 


o? = 1/Fr, (16) 


where F is the bandwidth of the error e(¢) and is as- 
sumed to be narrow relative to its midband. If this vari- 
ance is not sufficiently small, then since F is fixed by 
the system we must increase T, or use, in effect, the aver- 
age of many cycles of the square-wave perturbation. The 
latter is preferable, because t should be kept small 
enough to reduce variations in the parameter due to 
perturbation and to follow more quickly changes in in- 
put statistics or parameters. 

Thus the only means which can be used to reduce the 
variance of the integrator output is an increase in the 
number of perturbation cycles used, or, in other words, 
an increase in the averaging time in the integrator. This 
is equivalent to a decrease in loop gain, which will give 
slower closed-loop response. Some optimum must there- 
fore be sought which is a compromise between slow but 
steady response and faster but more noisy or uncertain 
response of the adaptive loop. Such compromises, be- 
cause of the complexity of the actual systems, may best 
be sought by analog simulation methods (see Section V 
below). 

As we go from the square-wave perturbation assumed 
above to the sinusoidal perturbation actually used in 
these studies, the modulated error may be assumed to 
be of the form given in (4). Its square will be 


e(t) = eo2(t)[1 + 2eym sin wit + ay2m,? sin? wt]. (17) 
The integrator output will be, if 2(0) =0, 
Ait! 
2) = saat €o2(p) [sin wip + aymy 
Le Jie 
— aim; cos 2wip|dp, (18) 


where terms in (am)? have been neglected as being 
very small compared to other terms. Let us further as- 
sume that integration proceeds up to a time t= 7”, where 
T” is the effective time constant of the adaptive loop. 
Since m; and €0°(¢) cannot be changed greatly by adap- 
tive loop transmission in time 7’, an open loop will be 
assumed, initially, and we have 


ig 
(1) ~ Tf et(p) [sin exp + camldp (19) 
0 


where the term of frequency 2, is small because 
T’>1/o1, in general, and am is small. An ensemble 
average of 2(7”) is 


Aye Co 
@a(T))= =i (eo?) [sin wp + aym|dp 
0 


‘Ag weel te costor ee 
i F Sie ne (20) 
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where a short-time estimate of €? replaces the ensemble 
average. If w,7”>>1, then 


(2(T’)) = Azetawms T/T. (21) 
This is of the same form as (8), times 7’, and indicates 

that the adaptive loop will tend to be effective in the 

random input as well as the sinusoidal input case. 

It is difficult to carry this analysis further in a mean- 
ingful fashion, although an attempt has been made to 
calculate the variance of 2(7’) in this open-loop case 
[10]. In order to do so, however, it is in turn necessary 
to know the autocorrelation of the error. Such an anal- 
ysis indicates that a filter following the squarer, and 
centered at a, will have no first-order effect on the vari- 
ance of 2(7’) but may give some slight reduction of 
z(Z”) due to second-order effects. This result is borne 
out by experiment, and, since filtering is desirable in 
any case to protect the multiplier from overload, it has 
been made a standard part of each adaptive loop. Some 
care must be exercised that the filter is not so narrow 
that added poles in the loop can result in instability. 

The adaptive loop output, ignoring random varia- 
tions, may be obtained from (21) by substituting the 
operator 1/p for 7”: 


arg 
A\€)°a\m 
C—O — 


7 (22) 


where as before (10) a subtraction is inherent in ™, 1.e., 


I 


My, Ki(ao = Gn); 
ao A €0?a1 Ky 


G= = 
pT 


a0 — An 


(23) 


(24) 


Thus, ignoring poles resulting from the addition of 
the filter, and from imperfections in multiplier and 
integrator, the loop-gain characteristic is such as to be 
always stable. However, it is proportional to ¢,?. 

A variation in mean-square error will necessarily oc- 
cur as the error is reduced by adaptive control. Of more 
importance is the variation in e,? as input signal or dis- 
turbance level changes. Some improvement can be 
gained by choice of an error function other than mean 
square [12]. The mean absolute value criterion, for 
example, is less sensitive to amplitude changes than the 
mean square. 

An effective scheme for minimization of the effects of 
change in input signal amplitude on e2(t), and thus on 
loop gain, has been to include a high-gain limiter at the 
output of the multiplier. This gives, in effect, a relay 
regulator, and furthermore it is one in which gain is 
easily controlled by setting the limiter amplitude. 

It will be noted in Fig. 7 that both the filter and the 
limiter discussed in this section have been included in 
each adaptive loop of the system studied by analog 
- computer methods. Z 
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One problem remaining in this system is to guard 
against misadjustment of parameters by the adaptive 
loop when the error signal amplitude is so low as to be 
unreliable for adaptive loop control. One possibility in 
this case is to introduce a dead-space in the high-gain 
limiters, so that the integrators will hold the value of the 
parameter reached before a reduction of error amplitude 
to some predetermined value. Switching and restora- 
tion of parameters to some chosen zero-signal value is 
also possible when the error signal sinks below some 
threshold. 


V. EXPERIMENTAL RESULTS 


The parameter-perturbation adaptive system was 
studied with the aid of an analog computer simulation 
of a third-order system, 

K(p6 + 1) 


C(p) 
= : - » (25) 
R(p) (pB+1)[p?+ p(4 + Ka) + K] 


shown in block form in Fig. 5. Variations of A, B, K 
and of the spectrum ®,,(jw) were assumed to be possible, 
with compensation to be made by self-adaptive adjust- 
ment of the controllable parameters a and B. The input 
y(t) was assumed to be the desired output. 

The computer used was the Wisconsin-Philbrick, 
built for the most part at the University of Wisconsin, 
using Philbrick plug-in amplifiers. It operates normally 
on a millisecond time base, making it a practical matter 
to process random data. Fifty-five operational ampli- 
fiers, seven multipliers, and a wide variety of nonlinear 
elements are available. 


Fig. 5—Block diagram of third-order system used in simulation. 


Fig. 6(a) shows the spectrum of e? when the input 
r(t) was a 200-cps sinusoid but the third-order system 
was adjusted for optimum square-wave response. Fig. 
6(b) shows the effect of varying a at 47 cps, and Fig. 
6(c) the effect of varying B at 31 cps. Fig. 6(d) shows 
the effect of varying both a and £. Note that com- 
ponents at the perturbing frequencies appear in e’. Tests 
were made with other settings for a and 8 with similar 
results. 

Fig. 7 is a block diagram of the complete system with 
two adaptive loops. Electronic multipliers were used to 
change the parameter values, as the simulator frequen- 
cies were too high for a mechanical servo to be used to 
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Fig. 6—Error-squared spectrum of third-order system with 200-cps 
sinusoidal input. (a) No perturbation. (b) @ perturbed at 47 cps. 
(c) 8 perturbed at 31 cps. (d) a and 8 perturbed; amplitude un- 
changed. 


Desired Output 


Input Third-Order 


Controller 


B 


Controller 


Fig. 7—Block diagram of parameter-perturbation scheme 
designed for adaptive control of two parameters. 


control a pot setting. The bias from the parameter con- 
troller on each input channel then determined the pa- 
rameter value. Again the input was regarded as desired 
output. With a random input the system would not 
work without the band-pass filters discussed in the pre- 
ceding section. It should again be noted that these 
filters are essential to prevent overload of the multi- 
pliers. The output of the correlating multiplier in each 
loop was amplitude limited. The limiter was found to be 
desirable for random inputs, not only to counteract 
changes in gain which would otherwise result as error 
amplitude changes (Section IV), but also to reduce the 
effects of sudden large “false correlations” which other- 
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wise would not only cause wide excursions in the param- 
eters, but could actually cause “statistical” instability in 
the adaptive loop. For the adaptive loops with limiters 
included, the effective loop gain can easily be controlled 
by adjustment of the limiting level. 


A 200 cps square wave was first used as the system 
input. Fig. 8 shows contours of equal mean-square error 
vs settings of a and B, the controllable parameters. In 
this figure the center of the grid is the point of minimum 
MSE. A change of one grid division on the @ axis cor- 
responds to a 25 per cent change in the parameter 
value. On the B axis one grid division corresponds to a 
16 per cent change. Also shown in Fig. 8 are a series of 
dots culminating in a solid line. These curves are the 
paths the parameters take when the adaptive loop is 
operating, causing the parameters to move toward the 
optimum adjustment at the center of the grid. Initially 
the parameters were misadjusted, then the adaptive 
loop was turned on and they moved to their optimum 
position. The dots occur at one-tenth second intervals. 
(With the periodic input the adjustment speed can be 
made much faster than shown but the system was set 
up with loop gains which were suitable for random in- 
puts.) 

Fig. 8 shows that the action of the two adaptive loops 
is such as simultaneously to change a and B so as to fol- 
low a path of steepest descent on the MSE surface. 
Comparison of the adaptive loop control with human 
control of the parameter values showed substantial ad- 
vantages in favor of the former mainly because of the 
difficulty that the human finds in minimization of a 
function which requires simultaneous variation of non- 
orthogonal or interacting parameters. 


Fig. 9 shows parameter response vs time for the 
case discussed above. In Fig. 9(a) the parameter q@ is 
periodically disturbed by a square wave. The first quick 
recovery of a corresponds to the steep descent to the 
valley of the MSE surface, and the following slow recov- 
ery to the descent along the valley floor to its deepest 
point. Meanwhile, 8 shows excursions which result from 
the interactions between these nonorthogonalized 
parameters. (If the parameters were orthogonal, 8 would 
not change as aq is periodically off-set.) 

Fig. 9(b) shows the effect of periodically disturbing 8 
with a square wave. 

The MSE surfaces for two random inputs were next 
determined. White Gaussian noise was passed through 
a shaping filter and applied as the system input. Fig. 
10(a) is for a shaping filter with a transfer function 


e 1 
age. ; (26) 
e; 10-2 + 0.05 X 10-p + 4 
while the contours of Fig. 10(b) are for the filter 
€0 1 
(27) 


e, (10-89 + 2)2 
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Fig. 8—Contours of equal MSE for square wave input. Also shown is 
the parameter adaptation towards the center of the grid (mini- 
mum MSE) from four different initial misadjustments. 


ete Gas) 


(b) 


Fig. 9—Parameter response to step misadjustments. 
(a) Step forced on a. (b) Step forced on p. 


(b) 


Fig. 10—Contours of equal MSE for two random signals. Also shown 
' “is the parameter adaptation as the inputs are changed from one 
-to the other. 
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Fig. 10(a) also shows a trace of the parameters adjust- 
ing to a change in the input signal. In Fig. 10(a) the 
starting position is at the minimum for the Alter of (27) 
and the input is changed to that of (26). Unlike the 
case of the square wave input, the adjustment does not 
move the point of operation directly to a minimum but 
“wanders” towards it. In Fig. 10(b) the filter sequence 
is reversed. These curves are continuous traces of the 
parameters’ motion over a period of 30 seconds. 

Fig. 11 shows the parameters adjusting to a change 
in input signal from the 200-cps square wave to the 
random output of the filter of (26). In this trace the 
dots occur at one-tenth second intervals. Thus with 
inputs in the 200-300-cps range it took about one second 
to reduce the MSE by a factor of four. If the adaptive 
loop gain is raised considerably, instability in the ad- 
justment is possible. Therefore all factors affecting loop 
gain must be chosen with a compromise between speed 
and the amount of wander in the adjustment paths. 

In an effort to check the operation of the adaptive sys- 
tem, the third-order system was reduced to second 
order with both 6 and B set to zero. With a square wave 
input a was allowed to adjust and its value measured. 
The sum of A and Ka was checked against the computed 
value for minimum integral squared error (ISE) for a 
step [11]. Although the measured value was 3.2 per 
cent different from theoretical, this measured value re- 
sults in less than a 0.1 per cent theoretical increase in 
ISE from the minimum. The ISE for a step input is a 
meaningful measure since the error essentially goes to 
zero in half of the square-wave period. 

As a final test with the second-order system, a limiter 
was included in series with K in Fig. 5. Fig. 12(a) shows 
the square wave response with damping held at the 
optimum value for the case without limiting, while Fig. 
12(b) shows the response when a is allowed to adapt. 
The value of @ in this case was just twice that of the 
optimum value without limiting. 


VI. CONCLUSION 


It has been shown that a linear system can be made 
to be both signal-adaptive and system-adaptive, 1.é., 
self-optimizing with respect to nonstationary random 
inputs and random parameter changes, by use of a 
parameter-perturbation scheme. This scheme, which 
works well for two adjustable parameters, should be 
readily adapted to more than two, and orthogonaliza- 
tion of the parameters with respect to the error meas- 
ure does not appear to be necessary. It also appears pos- 
sible to extend this system to the adaptation of essen- 
tially nonlinear systems, as well as the simple saturat- 
ing type of nonlinearity discussed in the preceding sec- 
tion. 

Although the mean-square criterion was used in most 
of the experimental work described here, other criteria 
[12] may offer advantages, particularly where the error 
spectrum is non-Gaussian. 
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Fig. 11—Response of a and 8 to input change from square 
waves to the output of the filter of (27). 


c(t) 


(b) 


Fig. 12—Response of second-order system with saturation to a 200- 
cps square wave. (a) Adjusted for optimum response if there were 
no saturation. (b) Derivative feedback allowed to adapt. 


The high degree of nonlinearity in this type of adap- 
tive system makes analysis difficult and leads to much 
use of approximation. Analog simulation, particularly 
high speed or fast-time-scale analog simulation offers 
considerable advantages in this study, particularly 
where random inputs are concerned. This would be still 
more true where second-order adaptation, or adaptation 
of the adaptive loop itself, made averaging times 
still longer. 

A general conclusion of importance in any application 
of this scheme is that it is not essential that the de- 
signer know in great detail the parameters or even the 
construction of the system to be adapted. Also, the 
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methods described can be realized with discretely as 
well as continuously variable components. 

The speed of response of any adaptive system is of 
key importance. In pure adaptation of the kind dis- 
cussed in this paper (7.e., where no preprogramming is 
possible), a certain amount of time lag is inevitable to 
permit “processing” of the information in the error func- 
tion. In this system the parameters were well adapted in 
1 to 2 seconds with inputs in the 200—-300-cps range 
(Figs. 8 and 11). The adjustment time should be pro- 
portional to the reciprocal of the operating frequencies. 

In more recent studies using slightly different tech- 
niques the adaptation time has been speeded up by 
factors of from 10 to 100. The authors hope to report 
on this in detail at a later date. 
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Optimum Prediction with a Mean Weighted Square 
Error Criterion’ 
CLARENCE C. GLOVER}, mMemper, IRE 


Summary—The linear prediction theory is examined using a 
mean weighted square error criterion. A specific nondeterministic 
weighting function is used. The problem is reduced to that of solving 
integral equations which are written in terms of correlation functions 
which can be calculated by averaging over the ensemble. A complete 
solution is given for the problem using Gaussian statistics with no 
correlation between noise and true signal. 


INTRODUCTION 


HE THEORY of linear least square smoothing 

and prediction was first developed by Wiener! 

and Kolmogorof.? Later it was examined in the 
frequency domain by Bode and Shannon.* Zadeh and 
Ragazzini* extended the theory to the case of finite ob- 
servation time. Booton® and Davis® further extended 
the theory to time-varying systems with nonstationary 
statistical inputs. In all of this work the system was 
considered optimum when the least mean-square error 
was obtained. 

The criterion of least mean square error has the dis- 
advantage that large errors are weighted quite heavily 
even when they occur at a time when the variable under 
consideration is large. This is usually contrary to what 
is desired. For example, an error of one foot in a meas- 
urement of 100 miles is not nearly as disturbing as is 
the same error in a measurement of 100 feet. Usually 
the per cent of value of error is of more interest than is 
the absolute error. This suggests using the mean square 
value of the quotient obtained by dividing the error by 
the value of the variable as the criterion of performance. 

This approach proves untenable when the variable 
has both positive and negative values and assumes the 
value of zero for some instant of time. Any error which 
occurred when the variable assumed the value of zero 
would be weighted infinitely large. Therefore, though 
one is in general interested in per cent error, in all 


* Received by the PGAC, June 15, 1960; revised manuscript re- 
ceived November 10, 1960. : ; 

+ Dept. of Elec. Engrg., The Johns Hopkins University, Balti- 
more, Md. ; 

1N. Wiener, “The Interpolation, Extrapolation, and Smoothing 
of Stationary Time Series,” John Wiley and Sons, Inc., New York, 
N. Y.; 1949. ; ; 

2 A. Kolmogoroff, “Interpolation und extrapolation von station- 
aren zufilligen folgen,” Bull. Acad. Sci. (URSS), Ser. Math. 4, pp. 
3-14; 1941. 

3H. W. Bode and C. E. Shannon, “A simplified derivation of 
linear least square smoothing and prediction theory,” Proc. IRE, 
vol. 38, pp. 417-425; April, 1950. : ' 
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6 R. C. Davis, “On the theory of prediction of nonstationary sto- 


‘chastic processes,” J. Appl. Phys., vol. 23, pp. 1047-1053; September, 
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measurements there is some value which should be con- 
sidered as essentially zero. This dictates the lowest ab- 
solute accuracy of interest and suggests the following 
criterion of performance: 


oe tee) et (6) (2 
/: ——“dlvhan 
Dov ral —r [fa]? + & 


where f(t) is the obtained function of time and fd(é) is 
the desired function of time. 6? dictates the lowest abso- 
lute accuracy of interest. The purpose of this paper is to 
examine how the linear prediction theory would be 
altered by adopting the latter criterion. This criterion 
shall be referred to as the mean weighted square error. 
The idea of a mean weighted square error criterion 
has previously been introduced in the literature by 
Murphy and Bold,’ but in their paper it was weighted 
by a deterministic function of ¢ alone. In this paper, the 
weighting is by a nondeterministic function, 7.e., 


(1) 


fears 


Some of the mathematics involved in the two papers 
are very similar, but the two processes are actually 
physically quite different. All the correlation functions 
in this paper are such that they are easily calculated 
from ensemble averages. The entire paper is limited to 
cases where the statistics are time stationary. The 
stochastic process involved is ergodic. All functions and 
variables which are in the time domain are real func- 
tions of real variables. Due to the similarity of the 
problems treated, part of the notation used in this paper 
has been adopted from Murphy and Bold. 


NOTATION 


In order to avoid repeated writing of certain integrals, 
the following notation will be introduced: 


rare 1 w 
f®) = ote sa | Sd. (2) 


In general, f(#) will be restricted so that 


il r 1 T 
im —— dt = lim — t dt. 3 
lim 7 a!) i) An es =| 7) (3) 


T— 0 


Using this notation, the mean-square error can be 


written as [e(t) |? and the mean-weighted-square error 


7G. J. Murphy and N. T. Bold, “Optimization based on a square 
error criterion with an arbitrary weighting function,” IRE TRANs. 
on Automatic ControL, vol. AC-5, pp. 24-30; January, 1960. 
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can be written as [e(¢) |2W(t). In the latter case W(#) 
will be understood to be the nondeterministic function 


i 
[fa(d) |? + 6° 


In addition, the ordinary cross correlation function can 
be written as 


bap(t1, 72) = A(t + 71) BCE + 72). 


As this particular correlation function can be shown to 
be a function of a single variable 7 =7, —72 it can also be 
written as duz(T). Weighted correlation functions will 
be written as follows: 


dwan(t1, T2) = A(t + 1) BE + 72) W(0), (4) 


the functions A(t) and B(t) as well as W(t) being 
bounded nondeterministic functions. In _ general, 
owap(t1, T2) cannot be expressed as a function of a single 
variable. The weighted auto correlation function com- 
mutates in the following sense: 


owaa(t1, T2) = bwaa(t2, 71). 


THE PROBLEM 
The problem is that of determining the optimum 
linear transfer function for a predicting filter where the 
filter will be considered optimum when the mean 
weighted square error is made a minimum. 


THE CONVOLUTION THEOREM 


As the systems under consideration are restricted to 
linear systems, the output c(t) can be calculated from 
g(t), the impulse response of the system, and s(t), the in- 
put signal to the system, by the convolution theorem. 
Therefore: 


c(t) =f sot — x)dx. 


Restricting the system to a physically realizable system 
dictates that g(t) =0 for t<0 and thus, the integral is 


c(t) =f sa)ot — x)dx. (5) 


THE WEIGHTED SQUARE ERROR AND MEAN 
WEIGHTED SQUARE ERROR 
The input signal s(t) will be considered to have a true 
signal component r(t) and a perturbing noise component 
n(t). Thus, s(t)=r(t)+n(). For a predicting filter the 
desired output ca(t)=r(t+7), where 7 is the prediction 
time. Then the error 


e(t) = c(t) — ca(t) = c(t) — r(t +7) 
= if One ade Tt). 
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The weighting function W(t) would then be 
i! 
[Put nP +e 


and, therefore, the following expression can be written 
for the weighted square error: 


leorwo= ff seo) E ee eee ~| andy 


[pe ee 


s(t — x)r(t + 4 
— 2 x dx 
J, g(@) ne PE air Lah 


E + r)r(t + = 
[Pe +r)? + el 
In taking the time average to obtain the mean-weighted- 


square error it will be assumed that the order of integra- 
tion can be interchanged which gives the following ex- 


pression for [e(t) |?W(2): 


(6) 


[e() PW) 
=f f see0)owel-@ +9, = + )ldedy 


wey {fF ° g(x) del —(e +2), Olde + ber(0, 0). 


MINIMIZATION OF THE MEAN WEIGHTED 
SQUARE ERROR 
The usual calculus of variation methods establish 


that for [e(t) |? W(t) to be a minimum it is necessary that 
g(x) satisfy the integral 


i NEM Pate oe he 


= ¢wer|—(x + 7), 0]x>0. (8) 


The verisimilitude of this statement can be made ap- 
parent by the following procedure: 


It is assumed that g(x) is the function which gives the 
minimum value of [e(¢) |2W(t) equal to k. Then this 
impulse function is perturbed by adding an arbitrary 
function h(x) multiplied by a constant to give 
g' (x) =g(x)+oh(x). This gives a new value to 
[e(¢) |? W(t) equal to k’ which cannot be smaller than 
k. Thus, k’—k>0. Deriving the expression for k’ —k 
in terms of g(x), o, and h(t) gives the relation 


bi —-k= 20 f h(x) | f e0)owal— C+ r), 
es (y =f t) |dy = bwerl —(x ala T); 0]} dx 


tee i f h(x)h(y)oweel— (+1), —(y-+ 7) Jandy. (9) 


In order for this expression to >0 for all ¢ and h(x), 
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(8) must be satisfied and, in addition, (10) must be 
satisfied. 


if { h(x)h(y) bwes| — (a+7),-(y+ t) |dxdy >0 (10) 


As W(t) is always >0, (10) is always satisfied when 
the order of integration can be interchanged as as- 
sumed in deriving (7).8 

EXTENSIONS TO THE CASE OF FINITE MEMORY 


Considering a further restriction on g(x) which de- 
mands that g(x) =0, x > 7, extends the theory to that of 
finite observation time. Then the following condition 
must be fulfilled by g(x): g(x) =0 for x <0 and x>T and 
for O0<x<T (11) must be satisfied. 


wid 
iE Bere eee) ya) ldy 
Jo 


= dwer|—(x + 7), O). 


Eq. (12) is also a necessary condition. 


(11) 


{ if h(x)h(y) bwes| — («+7),-—(v+ t) |dxdy = eet 2) 


Eq. (11) can be written in the following form: 


b 


{ ols) k(x, 9) dy = f(a) 


a 


(13) 


where 
R(x, y) = bwee| — (x fr T); =(y. 1 r) |, 


f(x) =@ws,| —(x+7), 0], g(y) is the unknown function, 
a=0, and 6=T. This integral equation is the well- 
known linear integral equation of the first kind, where 
the kernel function k(x,y) has the property that 
k(x, y) =R(y, x) and, 


b b 
ff f ech dads =: 


The solution of this mathematical problem is well 
treated in the mathematical literature. In addition this 
identical mathematical problem arises when the ordi- 
nary mean square error criterion is used with a nonsta- 
tionary stochastic process. Davis® treats the problem 
in considerable detail. Therefore, the solution of our 
problem is essentially complete for the case of finite ob- 
servation time. 


THE INTEGRAL WITH INFINITE LIMITS 


The methods of solution presented by Davis break 
down when the upper limit of integration is extended to 
x as in (8). Therefore, we cannot consider the prob- 
lem solved when the infinite past is used. This problem 
also arises in Booton’s paper® which treats the problem 
of the optimization theory for time-varying linear sys- 
tems with nonstationary statistical input. 


cance bids, see steps 56-62. 
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WIeENER-Hopr INTEGRAL EQUATION 


When the kernel function can be expressed in a func- 
tion of a single variable (x—y), the integral equation is 
easily solved even when the upper limit is extended. In 
fact this form of the equation is the well-known Wiener- 
Hopf integral equation which can be written in the form 


{ £(y) bss(% — y)dy = ger(a + 7) o> 0.7 4) 
0 


This equation occurs when W() is allowed to be equal 
to 1. Therefore, solving for g(y) gives the optimum lin- 
ear impulse response for the predicting filter when the 
mean-square-error criterion is used. Wiener’s solution 
to this problem is well known and can be written as 


fiz rifen Be 
P,5 (ju) s 


Ges &,,+(jeo) a <0 0 


where ®,,+(jw) X®;,;- (jw) =®,;(jw), G(Gw) is the Fourier 
transform of g(t), i.e. Gjw) = F{ g(t) HS Similarly ®,,(jw) 
= F | s(t) is etc. ®,,(jw) is factored so that ®,,+(s) has 
no poles or zeros with their real part greater than zero, 
and ®,;~(s) has no poles or zeros with their real part less 
than zero. Poles and zeros with their real parts zero are 
split between ®,,+(jw) and ®,,~(jw). 

This gives a special niceness to using the mean square 
error criterion, as it leads to an integral equation which 
is readily solved by taking Fourier transforms (the solu- 
tion being in terms of the ordinary correlation func- 
tions or their Fourier transforms). 


SOLUTION FOR SPECIFIED STATISTICS 


The use of the mean weighted square error criterion 
would be much more tenable if a solution for the opti- 
mum network could also be found in terms of the 
ordinary correlation function instead of the special cor- 
relation functions that appear in (8). Such a solution 
would depend on the nature of the process generating 
r(t), 2.e., the kind of statistical distribution involved. If 
the nature of the statistical process is known, then wap 
can be found by the following relation between time and 
ensemble averages: 


+0 A 
dwanlrn te) = fff papel yaddvdede (19) 


where p(x, y, 2) is the joint probability density function 
of the random variables x=fa(t), y=A(t+71), and 
z= B(t+r2). It is necessary to specify the nature of the 
process in order to proceed to a more detailed solution. 
One type process of special importance is the Gaussian 


process. 


THE SOLUTION FOR GAUSSIAN PROCESS 


Considering the process generating r(¢) as a Gaussian 
process, (15) can now be written in terms of the multi- 
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variate Gaussian distribution® for both of the weighted 
correlation functions needed in (8). Then the indicated 
integration can be performed, which will allow the two 
weighted correlation functions to be expressed in terms 
of ordinary correlation functions. It is convenient to 
use the normalized correlation function p. 


PAB a 


PABA 
OAOB 


MAMB 


Na = A (B) 


where 


OA WARIO = ale melGs 


AN EXAMPLE PROBLEM 


To illustrate the procedure the following simplified 
problem is considered, one of pure prediction [i-e., 
n(t) =0], where the coordinate system has been selected 
so that r(¢) =0. Then the integral equation which must 
be solved will have the form 


fs0)6ral-@ +7), =O + lay 


= ¢wrr|—(« + 7), 0] x >0. (16) 


Thus, it is necessary to find ¢yw,,(71, 72) in terms of p,,. 
Substituting the proper probability density function 
into (15) and performing the integration gives the fol- 
lowing results: 


dwrr(t1, T2) = Prr(71) Prr(T2) 


‘ ae Or et : e(e \ 
| ANE +7 Vexp = Sea 


Or 
F(Z)ow E(E) oe Ju(2) «7 
Doras 56) Oy Ks Wp) Tr 


where erfc is the complementary function to the error 
S funetion: (ericix i=11.—erf x).1° 

The normalized auto correlation function p4a(7) has 
the following properties: p14(0)=1, paa(t) =paa(—7). 
Thus, (16) can be written as 


ae Prp(T1 a T2) 


fr onl + don +9 
it (5 Gear ON 178 
[1 x Vee 7) ex 2 oS arto (—)| 
ir (ao 1/6\2 : ae75 i 
pee ee. & «p> (>) ae, 4 


Sesh (EC oe 2) ele) 
(18) 


9 Davenport and Root, “An Introduction to the Theory of Ran- 
dom Signals and Noise,” McGraw-Hill Book Co., Inc., New York, 
N. Y., pt. 8-3, pp. 151-153; 1958. 

10 “Mathematical tables,” in “Handbook of Chemistry and Phys- 
ics,” Chemical Rubber Publ. Co., Cleveland, Ohio, 11th ed., p. 301; 
1959. 
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This can be simplified by letting 


oT 1 /6\2 1/6 
pee ep (=) erfe —(—) =A, 
4 2 D2 \ Ge A) 2 NaOe 


and then 
A 


6 6 
-E) 
Or Or 


Then (16) can be written as 


I 


B 


Pr(x + 7) = a 
1—(1-B)f gs)on(y + dy 


f sodene = ydy D0. (19) 


For + <0 the solution to (19) is simply G(jw) =e" or 
g(t) =6(¢—7) which means the noiseless signal need only 
be delayed by | z| seconds. For 7>0 several solutions 
were obtained using particular forms_of p,,(7). In each 
problem examined the solution proved to differ from 
that obtained using the mean square error criterion by 
a constant multiplying factor. 

This leads directly to the following general solution 
for the problem of pure prediction using the mean 
weighted square error criterion where the signal r(f) is 
generated by a Gaussian process. The problem is first 
solved using the ordinary mean square error criterion 
which can be readily accomplished by using Wiener’s 
solution. This yields a solution gi(¢) for the impulse 
function of the system which is a solution of the follow- 
ing Wiener-Hopf equation: 


i £i(y) Pele — y)dy = prla+ 1) x 2S 0. QO) 
0 

Then the solution g(t) to the problem using the mean 
weighted square error can be found by multiplying 
gi(t) by a constant 1/K (.e., g(t) =(1/K)g:(t)), where K 
is given by 


K=B+(A1- B) [ g0a)oul9 + r)dy. (21) 


0 


To prove that this solution holds, it must be shown that 
(19) is satisfied by g(t), when g;(y) satisfies (20) and 
Kg(y) = gi(y). These conditions allow (20) to be rewrit- 
ten as follows: ; 


ff 8(Y) Prr(x — y)dy = i Pee + 7) = eS Of 422) 
0 


Substituting the right side of (22) for the left side in 
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(19) and substituting (1/K)g.(t) for g(t) gives 
Pre(x + 7) 


= BD WERK) p(s + i) S 9 
= «> 0. 


1 — (1 — B)(1/K) if POO casa, 


0 


(23) 


Therefore, 


B 
1 = 


K-(1-— B) f £1(¥) Pre(y + 7)dy 


0 


and 


K=B+(1- B) f £1(¥) Prr(y + 7)dy. Ones), 


0 


EXTENSION TO OTHER PROBLEMS 


This solution can easily be extended to cases where 
n(t) #0 providing that m(t) =0 and that there is no cross 
correlation between the noise m(t¢) and the true signal 
r(t). The equation corresponding to (19) is as follows: 


B 


Pr(x + 7) = = 
t= (= B) f g6rdpu(y + nay 


0 


[soda —sdy, 20 028) 
0 


Or\- On\” 
Pee Vs Yi Perr = —~-1 Pun 
Os Os 
Thus the solution g(t) =(1/K)gi(t) is found by solving 
the following Wiener-Hopf integral equation to obtain 


gilt): 


where 


Hi gi(¥)Pes(x — y)dy = p,r(x + 7), ea) el) 
0 
and 


K=B+(1~B)f s(v)only+ ray. 

0 

A and B are exactly as in the previous problem. 
Attempts to obtain similar solutions when the noise 

and true signal are correlated and with other types of 

statistics lead to the necessity of solving higher order 

transcendental equations and probably can only be 

solved with recourse to machine computations. 


CONCLUSION 


The statistical optimization theory developed by 
Wiener has been extended to using a mean weighted 
square error criterion. In the case of one specific weight- 
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ing function, the general problem has been reduced to 
one of solving integral equations. A complete solution is 
given for the problem using Gaussian statistics with no 
correlation between noise and true signal. The tech- 
niques employed can be extended to other weighting 
functions providing the function W(t) is always greater 
than 0 and is a nondeterministic function of time as 
indicated in the discussion. 

The latter restriction is important because when the 
weighting function is a definite function of time, certain 
integrations involved may not exist in the sense that 
they yield definite functions but yield new random vari- 
ables as discussed by Davenport and Root.!! For 
example @wan(t1, T2) may be a random variable. In 
other cases it may reduce to ¢1g(T2—71) to give exactly 
the same solution as W(t) =1 gives. 


APPENDIX 
Tllustrative Problem 


For an example of a particular problem we consider 
problem number one.!? Let s(¢) be a signal which is a 
sample function from a stationary random process with 
spectral density 


1 
Te) 
Show that the least mean square error predicting filter 
which operates on the infinite past has system function 


P(jw) = 


Gi(jw) = eo cos a + sin a + v2 (ju) sin Al 


where 7 is the lead time. First, we shall solve the prob- 
lem as stated and then we shall solve the problem for 
the least mean weighted square error, assuming that 
the statistics are Gaussian. 


Dabenige to the Problem 
inate rae Clic eas) 
oy = = = = : 
s) 1+ S*4 1+ +/2S+ S77 \l -—-V2S+S? 
The poles of the left term are 


S143 -1-j 
Se = Tie and Sy = oes 
The poles of the right term are 
1S ea) 1-7 
x= 5 and Sx = Ze : 
Thus 
Bas cee) 
1+J/2S+S? 


1 Davenport and Root, op. cit., see pp. 65-66. 
2 Davenport and Root, op. cit., see p. 247, 
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and il 1 
ANC oh oe 
il ie 
1 &(S) = 
#19) = ( zs ). i+ S* 14+ 7/2548?) 
1—f2S+ S? 
1 il 5 
Then Ea x2 | , 
; ieee 215-5) 
(ja) = ( zie teen :) i IS 
1+ V2 (jw) + (je)? pee 
res 2 2/2 
and i+ V2S4S3| to|¢\ 


Soe il 
es ( ayer on) 


Note that ®+(jw) and ®-(jw) are complex conjugates in 
the sense that ®+(—jw) =@~(jw). Following the pro- 
cedure indicated after (14) we need to find the inverse 
Fourier transform of ®+(jw)e*7 for ¢>0. For this par- 
ticular problem we can accomplish this by taking the 
inverse Laplace transform of ®+(S) and then replacing 
the variable ¢ with a new variable t-+7 as follows: 
1>0 F[+(jo)e*"] = L[+(S)] |e 
= ae t 

= V/f2e!2 sin — 

t+t4+r 


= a t 
Sin/2.en 2 sin (17 cos—=) 
V2 V/2 


a t 
+ cos es (m3 sin =) | ; 


To complete the process we take the Laplace transform 
of the above expression and multiply by 1/®@+(S) to 
obtain 


ae 
DN 2 at) 


t+t+rT 


Gis) = ently? [sin Vi + cos =F 


+ (v0 5) 


or 
Gi(jw) = e!”? sin Fi + cos oo, (v2 sin a (jo) | 


To obtain the solution for the least mean weighted 
square error we need to find $(t) = F—|®(jw) |. For this 
particular problem we can accomplish this by breaking 
®(S) into the sum of two terms, where the first term has 
poles and zeros in the left-hand plane and the second 
term has poles and zeros in the right-hand plane. Then 
we take the inverse Laplace transform of the first and 
replace the variable ¢ with a new variable | t| as follows: 


ae A en ltliv2 (con Hit 4. sin a = p(t). 


| ¢| | ¢| 
je be om 


and o2=1/2+/2. We also need gi(t) = F-[Gi(jw) | which 
gives 


= gp tlV¥2 a By ky: 
gilt) =e | (sin Va + cos 5) 6(t) 


+ (v2 sin =) a | 


where 6(f) is the unit impulse function and 6’(¢) is the 
first derivative of the unit impulse function. These 
functions are being used in the manner described in 
Appendix 1, (i.e, F[6"(¢) ]=(jw)”" and 


Thus, 


p(t) = en ltliv2 (cos 


n 


: f(x) 
ie x 


xot+e 
i f(x)6™(x% — ao)dx = (—1)” 


zwt=2r9 


Thus, we can write an expression for the constant K 
using (21). 


K=B+(1-B)f era 
0 


[oe sprseg)n0 + (400 Se 


: Ea (cos tt! + sin a dt. 
V2 V2 


Evaluating gives 


K= BLA p) im ae ay 
+ ( ) \e | (cos Va + sin 5) 


een mali | 


and then we can write an expression for 


1 1 
g(t) = = gi(t) or G(jw) = piel: 


8 Davenport and Root, op. cit., see pp. 365-370. 
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Control Systems with Minimum Spectral 
Bandwidth of Plant Input’ 


JAMES C. HUNG}, mMempBer, IRE 


Summary—A design method for control systems that minimizes 
the spectral bandwidth of the plant input signal is discussed. The 
plant input signal is minimized subject to the constraint that the 
integral square error for deterministic inputs or the mean square 
error for random inputs be limited to a known desired value. 

The control system transfer function that satisfies these require- 
ments is derived, and the functions used in bandwidth shaping are 
discussed. An example of a system design using this technique is 
given. 


GENERAL 


HE design of servo systems to minimize the high- 
eee power of the plant-input is derived in 

this paper. The minimization is accomplished 
with a constraint of a given integral square error for de- 
terministic inputs or mean square error for random in- 
puts. 

Limitation of the high-frequency power of the plant- 
input avoids exciting the higher-frequency modes of the 
plant. The transfer function of a plant can be separated 
into two parts, the low-frequency modes and the high- 
frequency modes. The low-frequency modes are simple 
in form and well-defined. The high-frequency modes are 
usually not known exactly, and inclusion of these terms 
in the design requires complicated compensation net- 
works in the control loop. Examples of high-frequency 
plant modes are motor shaft modes, body resonant 
modes of missiles, etc. 

The design of control systems to minimize the band- 
width of the closed-loop transfer function subject to an 
error constraint has appeared in the literature.! With 
certain control plants it is possible that limiting the 
closed-loop system bandwidth does not limit the spec- 
tral bandwidth of the plant input, and, as a result, the 
high-frequency modes of the plant are nevertheless ex- 
cited. The conditions for which the system bandwidth 
limitation does not also limit the plant-input signal 
bandwidth can be simply developed. 

Let G(s) be the known part of the plant transfer func- 
tion whose denominator polynomial is / degree higher 
than its numerator polynomial, and let A(s) represent 
the closed-loop transfer function whose denominator 
is k degree higher than its numerator polynomial. K(s) 
declines as frequency tends to infinity with an asymp- 


* Received by the PGAC, May 10, 1960; revised manuscript re- 
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the USAF under contract No. AF 49(638)-586 monitored by the 
Office of Scientific Res., Air Res. and Dev. Command, Washington 
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+ Elec. Engrg. Dept., New York University, New York, N. Y. 

1G. C. Newton, Jr., “Design of control system for minimum band- 
width,” Trans. AJEE, vol, 74, pp. 161-168; July, 1955. 


totic slope of —6k db per octave, and G(s) declines with 
a slope of —6h db per octave. With reference to Fig. 1, 
the transfer function relating the plant input to the sys- 
tem input is given by 


= TG) 5 K(s) 


coon RS te 


(1) 


Eq. (1) shows that at high frequency, the asymptotic re- 
sponse of M(s) varies at a slope of —6(k—h) db per 
octave, which is dependent on the values of k and h. If h 
is greater than or equal to k the function M(s) does not 
decline at all outside the system bandwidth. Under this 
condition, the high-frequency input and noise is not 
restricted from entering the plant, and the high-fre- 
quency modes of the plant can still be excited. 

To cope with this difficulty, this paper proposes a dif- 
ferent approach to the problem. Instead of limiting the 
bandwidth of the closed-loop transfer function K(s), 
the high-frequency power of the plant-input is mini- 
mized in the optimum design procedure. The system 
thus obtained is certain not to excite the resonant 
modes of the plant. 


“C(s) 


Fig. 1—Servo control system with fixed plant. 


THEORY 


Assume that the transfer function G(s) of the con- 
trolled plant is given, and that the tolerable integral 
square error, L, of the closed-loop system in response to 
a system deterministic input of R(s) is specified. With 
the given quantities a closed-loop transfer function 
K(s) is to be solved for, whose manipulated variable 
I(s), the plant input, referring to Fig. 1, has minimum 
high-frequency power. The quantity to be minimized is 
joo 

IIWWds = min (2) 


—jo 
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subject to the constraint condition that 
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In (2), W(s) is the weighting function which is used to 
shape the high-frequency asymptote of /(s). W(s) is in 
general a high pass filter of the form s” with n20. Since 
the output of the high pass filter is the quantity that is 
minimized, this forces the input signal to fall off at high 
frequencies. Thus, the high-frequency power of the 
‘plant-input is limited. The Laplace transform variables 
are represented by upper case letters, and their complex 
conjugates are represented by barred upper case letters. 
For example, 


Re= Rss R= R(-s). 

Let H(s) be the desired closed-loop transfer function. 
Then the error between the desired output and the sys- 
tem output is given by 


E-= R(H — K). (4) 
The plant-input signal is 


ve fe R (5) 

=e. 5 
G 

Eqs. (2) and (3) may be combined into one integral that 

is to be minimized by using the technique of Lagrange 

multipliers.? With (4) and (5) substituted, the integral is 


jo 


<u fe Soa 
21] GG 


+ \(H — K)(H — K)| ds.= min (6) 


when X is the Lagrange multiplier whose value is de- 

- termined by JL, the tolerable integral square error. 

The integrand of (6) is 
_[ KKWW alt cana 
lipee RR| CH HK) = R)|. (7) 
GG 

The integral of (6) is to be minimized considering that 
the system transfer function, K(s), is to be varied. It has 
been shown that the partial derivative of the integrand 
with respect to the conjugate of the varied function 
must have poles only in the right-half plane for the 


integral to be a minimum and for the system function 
to be physically realizable.* Let 


oF 


OK 
=~ KWW 
= RR| 
6 


2 R. Courant and D. Herbert, “Methods of Mathematical Phys- 
ics," Interscience Publishing Co. Inc., New York, N. Y.; 1953. 
8S. S. L. Chang, “Two network theorems for analytical deter- 
mination of optimum response physically realizable network character- 
istics,” Proc. IRE, vol. 43, pp. 1128-1135; September, 1955, 


NC = n) | 


February 


where X has only right-half plane poles. Rearranging, 


zi: WW 
x = RR[ K(— == +) — x1]. (8) 
GG 
Let 
Ww 
re ea (9) 
GG 
and 
RR (10) 


where Y and Z have all their poles and zeros in the 
LHP, while Y and Z have all their poles and zeros in 
the RHP. Substituting (9) and (10) into (8) and divid- 
ing by YZ gives 


AZH xX 


YZ = ee 
Ve YZ 


(11) 
The term in the left-hand side of (11) is analytic in the 
RHP, since K is implemented to be a stable system and 
Z and Y are analytic in the RHP by definition. The 
first term in the right-hand side of (11) may have poles 
in both sides of the s-plane. Using a partial fraction 
method, this term can be separated into two parts as 


\ZH \ZH AZH 
ue A Amel \ oe 
where the part inside the bracket [|], is analytic in the 
RHP, and the part inside the bracket []_ is analytic 
in the LHP. The second term in the right-hand side of 


(11) is analytic in the LHP from the definitions of X, Y 
and Z. Eq. (11) can therefore be written as 


A\ZH \ZH x 
1 Ale. lee TZ, 


The left-hand side of (12) is analytic in the RHP, while 
the right-hand side is analytic in the LHP. There are no 
poles common to both sides of (12); therefore, both sides 
should be equal to zero, giving 


(12) 


\ZH 
VZK — =| = 0. (13) 
Veale 
The optimum closed-loop transfer function is 
te AZ. 
=| > | : (14) 
SAT 


To find the value of \, (14) and (4) are substituted into 
(3) and the integration is performed. 

It is obvious that the use of different weighting func- 
tions, W(s), results in plant-input transfer functions, 
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M(s), having different high-frequency cutoff character- 
istics. This can be seen from the following considera- 
tion. 

Consider a system with H=1, R=1/s, and G=Z/P. 
where Z is a polynomial of degree z, and P is a poly- 
nomial of degree p, and p>z. Then 


Using (9) and (10), we have 


nae ww _ WWPP+22ZZ 00 
GC Zz Paez 
eee desl 
La, = eee 
S2 


where W is equal to s”, and Q is a polynomial of degree 
qg=p-+n. From (14), 


peerond (1 hz A 4 
ae 
eS: Q 


where A is a constant. Since g—z=p+n-—z is always 
positive, K(s) always vanishes as frequency increases. 


_ The plant input function 


has a high-frequency cutoff rate of g-—p=p+n—p=n 
units. That is, M declines at the rate of —6mn db per 
octave at the high-frequency end. Techniques of choos- 
ing the value of n will be illustrated in the example fol- 
lowing this section. 

The method presented so far is for systems having 
deterministic inputs. Extension of the method to the 
case of random inputs is obvious. In the latter case, the 
input power spectrum ®,, replaces RR in (6), and the 
high-frequency power of the plant input is minimized 
subject to a specified mean square error constraint. 

It should be noted that the same method can be used 
for the design of optimum closed-loop systems either by 
minimizing the integral square error, or by minimizing 
the mean square error, subject to a specified high- 
frequency plant input power limitation. 


ILLUSTRATION 


To illustrate the design procedure discussed in the 
previous section, an example of the design of a closed- 
loop system will be given. Referring to Fig. 1, let the 
known part of the plant transfer function be G=1/s’, 
the desired closed-loop function be H(s)=1, and the 
input R(s)=1/s. The tolerable integral square-error of 
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the system in response to the deterministic input is as- 
sumed to be not greater than one, i.e., LS1. 

First let the weighting function be W=1. Then (9) 
gives 


day A ae ee 
ba Shy or = 8 d 
GG 
= (s+ a)(s + a@(s — a)(s — @) (15) 
where 
@ = dei) and g@ = Ase HEI, (16) 
Eq. (10) gives 
La 1 
LL RR (17) 
S52 


Separating (15) into left- and right-half plane terms, 
we have 


Vag sae (18) 


Y = (s — a)(s — @) 


Substitute (18), Rk, and H into (14), 


1 pe 
K ES ise =| ° 
Vise Vat 3 


Evaluating using the left-half plane terms in the bracket 


S r aa 
K.= = - (19) 
(s+ a)(s+ 4a) ads (s+a)(s+ a) 


The plant input function is given by 
K Sad 


G salle). 


(20) 


To evaluate \, substitute (19) into (3), giving 
() 1 oie) bea 
i; edt = — EEds 
0 TT] J —joo 
yoo 
RR(1 — K)(1 — K)ds 
T)] YS —joo 
1 fe b+@talls—-@+a] | 
Qj J —jo(s + a)(s + &(s — a)(s — 4) 
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From (16) it can readily be seen that 


I 


I 


Cpa = 0; 
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a 3 1.06 
il Ch == <a 
0 2(a + a) ee 


Since L=1, the limiting value of X is 
Ne (06) esa ale 262: (21) 


Insert the value of \ into (19) and (20), resulting in 


Ping 1.123 
(s + 1.06/45) (s + 1.06/ — 45) 


1.123 
aes 5 (22) 
s? + 1.55 + 1,123 


and 


1.1235? 
M = (23) 
$2042 155-4 1,123 


Next, let W=s, and follow the same procedure. For 
this case, 


Ae e20:85: (24) 
ae 4.566 
(s + 1.659)(s + 1.659/60)(s + 1.659/—60) 
4.566 
S?+ 3.3185? + 5.55 + 4.566 
and 
4.566s? 
M= - . (26) 
s® + 3.3185? + 5.55 + 4.566 
Finally, let W=s?, obtaining 
A = 435.48, (27) 
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Fig. 2 shows the frequency response curve of the three 
plant-input functions given by (23), (26), and (29). The 
high-frequency asymptotes have slopes of 0 db, —6 db, 
and —12 db per octave for W=1, W=s, and W=s? 
respectively. From the curves it can be seen that if the 
plant high-frequency mode is lower than 4 radians per 
second, W=1 is the best weighting function to use. If 
the plant high-frequency mode is between 4 and 5$ 
radians per second, then W=s is the best weighting 
function. For modes higher than 5 radians per second, 
W =s? is the best one among the three. Using weighting 
functions with higher degrees than necessary certainly 
gives desirable high-frequency noise attenuation, but 
at the cost of an unnecessarily complex system. From 
the graph it can be seen that the higher, order weighting 
functions give systems that are more susceptible to 
noise disturbance near the cutoff region. 

If series compensation alone were used for the above 
system, the compensation device would have a zero at 
the origin which would block off the de reference input. 
This difficulty will be eliminated if both series and feed- 
back compensation networks are used. 

The system configuration to be used is shown in Fig. 
3. The transfer function of the compensation units are 
given as follows. For the-first system, W=1 


G, = 1.123 


Gy 


1.33(s + 0.75). 


For the second system, W=s 


4.566 
6, = 
s + 3.318 
G; = 1.21(s + 0.833). 


For the third system, W=s? 


26.46 


G, = 
Se 9.9215 0 


G; = 1.15(s + 0.868). 


26.46 


(5 + 2.268/67.5)(s + 2.268/—67.5)(s + 2.268/22.5)(s + 2.268/—22.5) 


26.46 


and 
26.465? 


M = : 
s4 + 5.9275 + 17.56s? + 30.49s + 26.46 


(29 


st + 5.9275? + 17.565? + 30.49s + 26.46. 


(28) 


The root-locus plots of these three systems are shown 
in Figs. 4, 5, and 6, and the corresponding gain points 
are indicated. 
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Fig. 3—System configuration for the illustrated problem. 


CONCLUSION 


The method of implementing the optimum control 
system for minimum high-frequency power input to the 
plant has been presented. The choice of the weighting 
function for the plant-input function has been discussed 
and illustrated. The system thus obtained is certain not 
to excite the high-frequency resonant modes of the 
plant. 

It should be pointed out that the applicability of the 
proposed method lies on the condition that the fre- 
quencies of the plant resonant modes are higher than 
those of the input signal. In the case where the fre- 
quencies of the plant resonant modes are close to the 
signal frequencies, the exact plant transfer function, 
including all its resonant modes, should be used in the 
optimizing procedure. 
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Fig. 4—Root-loci of illustrated problem for W=1. 
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Fig. 5—Root-loci of illustrated problem for W=s. 


2.964 + 52964 


K(s +0.868) 


Gs Gf G = || K= 30.49 


s*(5 +296 + j2.964)(s +296 -j2.964) 


-2.964 -j2.964 


Fig. 6—Root-loci of illustrated problem for W=s?. 
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A Network Theory for Carrier-Suppressed 
Modulated Systems” 


GERALD WEISS{, SENIOR MEMBER, IRE 


Summary—The performance of linear networks in the presence 
of carrier-suppressed modulation is re-examined in the light of the 
latest advances in theory. Both analysis and synthesis methods are 
presented. 


INTRODUCTION 


UITE early in the development of feedback con- 
trol systems it became apparent that the electri- 
cal portions of such systems could be consider- 

ably simplified if modulated signals were to be used. 
In particular, the use of carrier-suppressed modulation 
seemed to lead to appreciable equipment economies. At 
that time the analysis of a modulated system could be 
carried out only on an approximate basis, but the per- 
formance of the equipment verified the validity of the 
approximations. Since these early days, carrier fre- 
quency (or ac) control systems have been designed 
and built in complete confidence, despite the absence of 
an exact theory. 

Fifteen years later theory has finally caught up with 
practice. As a result of the work of a number of authors, 
it is now possible to construct a unified and reasonably 
complete theory of linear carrier-frequency networks, 
covering both analysis and synthesis. This theory is 
re-presented in this paper. Included are several novel 
features: 1) a method of obtaining the zeros of envelope 
functions, using root locus techniques, and the applica- 
tion of the method to the commonly used lead net- 
works; 2) a derivation of the low-pass band-pass trans- 
formation as a solution to the synthesis problem, using 
a logical approximation method; 3) a derivation of the 
commonly used RC network functions by the same ap- 
proximation; 4) a numerical evaluation of the approxi- 
mation, demonstrating the inherent “wide-band-ness” 
of these so-called “narrow-band” networks. 


CARRIER-SUPPRESSED MODULATION 


The conventional ac control system uses carrier-sup- 
pressed modulation with a sinusoidal carrier. The un- 
modulated signal e(f) becomes the modulated signal 


* Received by the PGAC, May 13, 1960; revised manuscript re- 
ceived October 12, 1960. This paper is an extract from the disserta- 
tion “Carrier Frequency Networks,” submitted in partial fulfillment 
of the requirements for the degree of Doctor of Electrical Engineering 
at the Polytechnic Inst. of Brooklyn. The investigation was carried 
out at the Microwave Res. Inst. and was supported by the U. S.A.F., 
Rome Air Dev. Center, under Contract No. AF-30(602)-1648. 

+ Dept. of Elec. Engrg., Polytechnic Inst. of Brooklyn, Brooklyn, 
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e(t) cos wt, where w, is the carrier frequency. If such a 
modulated signal is applied to a linear network, the out- 
put is of the form 


eo(t) = ex(t) COS wet + e2(t) SiN wel, (1) 


that is, it is made up of two modulated voltages. Now if 
these two voltages are in turn applied to a linear net- 
work, the output is of the same form. Hence one can say 
that the pair of voltages in (1) forms a complete set, or 
closed set, with respect to carrier-suppressed modula- 
tion by a sine wave. The resolution into sine and cosine 
components is quite arbitrary, and one could just as 
readily write , 


eo(t) = e1/(t) cos (wet — 10°) 
— es'(t) cos (wet + 594°). (2) 


The signal resolution of (1) is more practical because it 
is orthogonal with respect to the operation of demodula- 
tion. For example, a carrier-suppressed demodulator 
such as a two-phase induction motor or a ring demodu- 
lator can be aligned to “accept” the component e(é) 
and “reject” the component é2(¢). Hence one may view 
the signal form of (1) a complete orthogonal set for this 
type of modulation. 
Consider now a linear network with input signal 


r(t) = ry(Z) sin wet + ro(t) cos wel. (3) 
The output is 
c(t) = c¢/(£) sin wet + €2/(t) COS wel. (4) 


This is a perfectly adequate way of describing the input 
and output signals. A more general description, how- 
ever, is the one proposed by Panzer! and shown in Fig. 
1. The input-output pair is now 


r(t) 
c(t) 


ri(t) sin wet + ro(t) COs wel, 
cr(t) Sin (wet + b) + co(t) cos (wt +4). (5) 


t 
r(t) Pon | c(t) 


Fig. 1.—Envelope network response. 
r(t) = ri(t) sin wet + re(t) Cos wet, 
c(t) = ci(t) sin (wet + $) + €2(t) cos (wet + 4). 


ll 


1M. Panzer, “Envelope transfer function analysis in a- - 
systems,” ATEE Trans., vol. 75, pt. 2, pp. 274-279 PNoverben t66. 
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Both r(¢) and c(t) are expressed in orthogonal form, but 
there is now an arbitrary phase angle @ between the 
input and output signal resolutions. This form of sig- 
nal description is useful in practical ac servos where the 
demodulator phase alignment is not perfect. For ex- 
ample, in a simple synchro servo, (t) may be the error 
signal generated by a pair of synchros, and ro(t) may 
represent quadrature terms in the synchro output. The 
servomotor main field may be misaligned with respect 
to the synchro output 7(¢) by the angle ¢, possibly be- 
cause of the phase shift through the synchros. The per- 
formance of a network inserted between synchro and 
motor is then best described by the signal resolution 
shown in Fig. 1. This particular resolution permits 
evaluation of the network performance in the presence 
of both quadrature and phase misalignment. The net- 
work envelope performance is thus deliberately made a 
function of the arbitrary carrier phase resolution angle ¢. 

A more compact signal description is attained by re- 
placing the sinusoids by complex exponentials, as pro- 
posed by Chang.?? Eq. (3) becomes 


r(t) = Im, [ri(¢) + iro(d) Jet (6) 
or, in the usual short-hand ac notation 
r(t) = ri(t) + ire(?). (7) 
One can also define the Laplace transform 
Ri(p) = Sn] 


and similarly for Ro(p), Ci(p), and C2(p). Every carrier- 
suppressed signal has two envelopes, and each can be 
expressed as a time function or as a frequency function. 
In the complex frequency domain the two envelopes 
can be combined into the function 


Renv(p) = Ri(p) se iR2(p). (9) 


Pp = om + jom (8) 


This notation was suggested by Panzer! and he calls 
Renv(p) the “entire” envelope function. Note that p is a 
complex variable in j, hence, Reny(p) is a doubly-complex 
function in both 7 and 7. 

In the discussion to follow, it is assumed that all the 
envelopes are bandwidth limited to w,, the carrier fre- 
quency. In other words, the envelope e(t) may have a 
spectrum as shown in Fig. 2(a). The corresponding 
spectrum of the modulated signal e(t)cosw.¢ is then 
shown in Fig. 2(b). If the envelope bandwidth is limited 
as shown, there is no overlap in the sideband spectra 
and the envelope is recoverable by demodulation. 

The question immediately arises as to what happens 
when the envelope is a step or a ramp, signals with 


2S, S. L. Chang, “Transient analysis of a-c servomechanisms,” 
AIEE Trans., vol. 74, pt. 2, pp. 30-37; March, 1955. . 

3S. S. L. Chang, “On the separability of Laplace transform varia- 
ble and its applications in carrier systems,” IRE CONVENTION REc- 
ORD, pt 2, pp. 27-34; 1955, 4 
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(b) 


Fig. 2.—Spectrum of modulated signal. (a) Envelope 
spectrum. (b) Signal spectrum. 


infinite bandwidth. Experimental investigations of ac 
systems do not reveal any difficulties, and perhaps this 
question is of little importance in today’s servo practice. 
The theoretical problem is puzzling, however, and sim- 
ilar problems have arisen with other types of modula- 
tion, for example, in sampled data systems. 

In any case, it has been pointed out by Chang? that 
the signal description of (1) is not unique when the en- 
velopes are allowed to have spectral components at the 
carrier frequency. Hence the assumption of bandwidth 
limitation is desirable at this point. 


ENVELOPE TRANSFER FUNCTIONS 


The concept of the transfer function is basic to all 
current control system analysis methods. The transfer 
function of an element or network for unmodulated sig- 
nals is simply the ratio of the Laplace transform of the 
output to the Laplace transform of the input. The 
transfer function of a demodulator such as the servo 
induction motor is the ratio of the Laplace transforms 
of the output shaft angle to the envelope of the control 
field voltage. The transfer function of a modulator such 
as the ac induction tachometer is the ratio of the Laplace 
transforms of the envelope of the output voltage to the 
shaft angle. Hence the familiar transfer functions of 
these electromechanical devices are really a species of 
envelope transfer function. 

It is desirable to employ the same scheme for the 
transfer function of an electrical network used with 
modulated signals. The significant quantities are the 
envelopes, hence the network characteristic of interest 
is the envelope transfer function, the ratio of the La- 
place transforms of the envelopes. An immediate difh- 
culty arises, however, because both the input and out- 
put signals have two envelopes, not one. Hence any of 
the four ratios 


A RC) 
Ri(f) R2(p) Ri(p) 


would appear to qualify as envelope transfer functions, 


C2(p) 
Rx(p) 
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This conceptual difficulty is immediately overcome by 
use of the doubly-complex notation of (9), and one can 
define an envelope transfer function 


Sean ac ee es 
Rew p) 


Inserting the definitions of Cenv(p) and Renv(p), one ob- 
tains 


(10) 


Ci(p) + iCo(p) = [Go(p) + Gol) ][ Rip) + iRo(p)] (11) 
which can be rewritten 
Ci(p) = Go(p) Ri(p) — Gel(p) R2(f) 
Co(p) = Gop) Rild) + Go(p) Ro(P) (12) 
or in the form of a matrix equation 
| Cilb) | _ | Go(p)  —Gol(p) | Ri(p) (13) 
C2(p) Go(p) Gp(p) || Ro(p) 


The doubly-complex quantities are thus most readily 
viewed as skew symmetrical matrices. Subscripts 1 and 
2 signify envelopes for the sine and cosine components 
of the carrier, respectively. The envelope transfer func- 
tion component Gp(p), the direct envelope transfer func- 
tion, is seen to relate the sine component of the output 
to the sine component of the input, and the cosine com- 
ponent of the output to the cosine component of the 
input. The envelope transfer function component Ga(Pp), 
the quadrature envelope transfer function, relates the 
sine component of the output to the cosine component 
of the input, and vice versa. 

The response of a linear network to carrier-suppressed 
modulated signals is thus characterized by two envelope 
transfer functions Gp(p) and Ge(p), which can be com- 
bined into one doubly complex function Geny(p). En- 
velope function theory concerns itself with two topics, 
analysis and synthesis. The analysis problem is: given 
the network transfer function in the usual sense, what 
are the envelope transfer functions? The synthesis prob- 
lem is the converse, but in its usual practical application 
the problem is: given the direct envelope transfer func- 
tion of a network, what is the transfer function of the 
network in the usual sense? 

The arguments here presented apply not only to 
transfer functions, but to all network functions, driving 
point or transfer, impedances, admittances, voltage 
ratios, and current ratios. 


THE ANALYSIS PROBLEM 


The problem of determining the envelope function of 
a given network has been considered by a number of 
authors. Following the pioneering work of Sobczyk,‘ the 


4 A. Sobezyk, “Stabilization of carrier-frequency servomechanisms. 
Part I: Gain-phase margin diagrams of controller characteristics,” 
J. Franklin Inst., vol. 246, pp. 21-43; July, 1948. 
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first to define the envelope transfer functions was 
Biernson:® he derived the relationship between the en- 
velope functions and the usual network function based 
on a sinusoidal envelope. Chang? and Candy® intro- 
duced the concept of the doubly-complex variable. Tou,’ 
Panzer! and Levenstein® presented derivations for ar- 
bitrary envelopes. The derivation of Panzer is the most 
rigorous and complete; given a network with transfer 
function H(s), the envelope function. is 

Honv( Pp) = F env( Pp, g; We) ae H(p =F ie )e Fs (14) 
The envelope function is thus seen to be dependent on 
three phenomena: the frequency dependence of the orig- 
inal network as expressed by the complex frequency ), 
the arbitrary carrier phase resolution angle ¢, and the 
carrier frequency w.. The two components are given by 


Hyp; ?, We) i Re; [H(p =P iwe)e*]) (15) 
Hol, $, we) = Im; [H(p + iw ]f 
It is convenient to define the functions for ¢=0 
Hpol(p, We) = Hp(p, 0} We) 
= 2|H(p + iw.) + H(p — iw.)] 
Hav, We) — HQ, 0, We) (16) 
1 
= 5; [HO + ie.) — H(p — tw.) 
where 
Hp = Hypo cos¢+ Haosing | re 
Ha = — Hposin¢g + Hao cos ¢ oe 


Finally, at real frequencies p=jw,, one obtains Biern- 
son’s formulas? 


il 
AH pol jum, We) = m | Aj (we sp Wm) | 
+ H* i] We — Wm 
[iC 1} a 


P 1 
Hao( jem, &e) = a | A] j(@e + wm) 


= H*|j(we me wm) |} 


where * designates the complex conjugate. It should be 
pointed out that the various authors do not agree in 


*G, A, Bjornson, “Network synthesis by graphical methods for 
a-c servomechanisms,” ATEE Trans., vol. 70, pp. 619-625; 1951. 
“gt C. J. N. Candy, “A vector method for amplitude-modulated 
signals,” Proc. IEE, vol. 103, pt. B, pp. 410-418; 1956. 
' 7 J. Tou,, ees of es ne systems containing carrier 
requency circuits,” Proc. Natl. Electronic : - 
ae gee onic Conf., vol. 11, pp. 1012 

* H. Levenstein, “On the design of ac networks for servo com- 


pensation,” IRE Trans. on AuToMATIC ConTROL, vol. AC- 
39-55; February, 1957. » vol. AC-2, pp. 


1961 


their definition of the sign of Hg. The presentation here 
follows that of Panzer;' the convention used by the 
other authors would require a reversal of sign in (10). 

Eq. (18) can be used to obtain the envelope function 
of any device for which the usual gain and phase vs fre- 
quency curves are known. Eq. (15) and (16) are useful 
when an analysis is to be made in terms of poles and 
zeros. The relationship between H(s), Hp(p), and He(p) 
becomes clearer when the functions are expressed in 
terms of their poles and the principal part of their 
Laurent series.* Table I indicates this relationship for a 
few special cases such as simple poles, real poles, com- 
plex poles, etc. It is seen that each pole of the network 
function H(s) converts to a pair of complex poles of the 
envelope functions, displaced from the original poles by 
—jw,-. Furthermore, there is a definite relationship be- 
tween all three functions: if either one is given, the other 
two are completely determined. 

The location of the zeros of the envelope functions 
can be obtained by a conformal mapping technique 
analogous to the root locus method. This technique was 
first applied to a related problem by Smith.® 


90. J. M. Smith, “Feedback Control Systems,” McGraw-Hill 
Book Co., Inc., New York, N. Y., ch. 18, p. 607ff; 1958. 
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Or 
“i 


Starting out with (16) for the case of ¢=0, it is de- 
sired to solve 


2H po(p) = H(p + jure) + H(p — jor) = 0) 49) 
2jHoo(p) = H(p + joe) — H(p — joe) = 08 
One can write 
H(p + jw.) + KH(p — joc) = 0. (20) 


Assuming K to be also a function of p, K(p), the pro- 
cedure is to map the real axis of the K-plane onto the 
p-plane. At K =1 the locus gives the zeros of Hpo, and 
at K=-—1 the zeros of Hg. The complete locus will 
hereafter be referred to as the envelope locus of the 
function. To facilitate the mapping, the functions are 
expressed as a ratio of polynomials M(s)/D(s). The 
mapping equation is then 


N (pt joc) D(p — jae) + K(p) N (p — jure) D(p+joc) =0 (21) 
or, in short-hand notation 
CNC Ve RUNS) De) 20; (22) 


where the roots of all the D and N functions are known. 
Denote the roots of (V+) and (D-) as “poles,” and the 
roots of (V-) and (D+) as “zeros.” The roots of (24) can 
then be obtained by standard root locus technique. Posi- 


co & 


TABLE: 1 
POLE AND RESIDUE RELATIONSHIPS 
ei?H(s) Hp(p) Hp) 
1 ei?Ag Ay cos ¢ — Agsin¢d 
2 e iF Ais Ai(p cos ¢ + w sin ¢) A\(— psin 6+ @, cos ¢) 
SE zAei? 4Aci? = Aei* Aei? 
e7 , n Tne ,, n = —. 
(s + a)” (p + 4 — jor)” (pb + a + jor) GO aos tapi eee 
4 Ao 0 
5 Aip Ajare 
1A 4A : A S A 
6 peal URES ae, 
sta PHa—joc Prat joc at earns Vere wie 
ad 9B) 3(A — jB) s) 2j(A +jB) FIA J) 
LL MR eet pta—jb—w) | ptatjb—w) pta—jb—w) | ptatjb—a) 
Oo ROR Papa 3(A + 3B) }(4 — JB) Pi Ae ee sea) 
pta—jbto) — ptatjo +o) pra-jbto) ptatjbt+) 
A —jB A+ jB A - 4 4(4 +98) 3(A — jB) B 2j(A +3B) _4j(A — 3B) 
: statjoc | s+ a — joc pHa pta—jlw  p+at jw pa! pta—jdw ptat jw 
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tive real K’s map into the 180° locus, and negative real 
K’s map into the 0° locus. The K= +1 points are ob- 
tained by measuring the ratio of pole and zero distances. 
This construction may not even be necessary because it 
is apparent that | K| =1 along the real axis. 

A simple example of the technique is shown in Fig. 3 
for an RC coupling network. In case (b) the zeros of 
Gp» are the real axis intercepts, in case (c) they are lo- 
cated on the vertical axis of symmetry for the zero-pole 
constellation. The zeros of Ggo are at infinity; there are 
two branches going to infinity, therefore Geo has a 
double zero. Of course, the zeros of this simple network 
could easily have been obtained algebraically. The util- 
ity of the method becomes apparent when the network 
is at least a biquadratic. 

Several features of this type of conformal mapping 
may be worth noting. The critical points designated as 
“poles” and “zeros” do not occur in complex conjugate 
pairs, but for each “pole” there is a complex conjugate 
“zero.” Since the relationship between the (N+) and 
(V~) functions is 


N*(p + juc) = N(p* — joe) (23) 
and similarly for D, one can derive from (21) 
Kn) (24) 


K(p*) 

This means that if a real value of K, say Ki, maps into 
bp, another real value Ko2=1/Ki, maps into p*. Hence 
the complete envelope locus is symmetrical about the 
real — p axis, but the mapping of the individual K-point 
is not, except at K= +1. 

The polynomials (N+)(D-) and (N-)(D*) are of the 
same degree and the coefficients of the leading term are 


identical. Hence at least one of the K = —1 points is at 
infinity,!® in addition to any degenerate locus at in- 
finity. An envelope locus with a single K = —1 point at 


infinity pictorially resembles the conventional root locus 
of a feedback system of asymptotic order 2, because 
there is one half-branch going to and a second half- 
branch leaving the K = —1 point. The functions shown 
here have two infinite Hgo zeros, so that their envelope 
loci resemble the root locus of feedback systems of 
asymptotic order 4. 

Now consider the general case of 6#0. From (17) one 
obtains 


(Bi) CD) a ar N-)CD*) = 0. (25) 


The zeros of (25) are obtained by mapping the unit 
circle of the K-plane onto the p-plane, using (22) as the 
mapping equation. Along this circle K(p) is equal to 
e??) so that (22) becomes 


Ce) De 2) GN) (Dt 0. (26) 


10H. Ur, “Root locus properties and sensitivity relations in con- 
trol systems,” JRE Trans. on AuToMaTic ConTROL, vol. AC-5, pp. 
57-65; January, 1960. 
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(c) 


Fig. 3.—Root locus of coupling network. 


(a) RC coupling network. 


G(s) = =—— fs 
ScoRG 
+ 4a 
G(p + jax) = 2S _. 
——— 4 4 i 
geo i) fe 
(b) Locus for 
1 
aati 
RC 
(c) Locus for 
1 ni, 3 
Roe oe 


For (b) and (c), arrows show direction of increasing K; 


The zeros of Hp(p, $) are located at the mapping of 
6= 29; the zeros of Ha(p, ¢) are located at the mapping 
of 0=2¢—7. Fig. 4 is a simple example of such a locus, 
for the same network as in Fig. 3(b). The unit circle 
mapping is, of course, orthogonal to the envelope locus 
mapping, and exhibits the same asymptotic order. The 
entire real-p axis must be a portion of the unit circle 
mapping. Each point on the unit circle of the K-plane 
maps into pairs of conjugate complex (or real) points 
in the p-plane, because 


A(p*) = O(p). (27) 


Fig. 4—Unit circle mapping for coupling network. 


1 
G(s) = (2 tted for — = 2): 
(s) otted for RC 3e, 


Ss) Se 
RC 
locus of |K| =1, direction increasing 0. 
------- locus of K real, direction increasing K. 
ZEROS OF AC LEAD NETWORK 


The commonly used ac lead networks, bridged-7, 
parallel-7, and resonant damper, are characterized by 
the biquadratic transfer function 


s? + 2as + w,? 
s? + 2bs + w,? 


G(s) = a <b nar ae, (28) 


This function is obtained through the low-pass band- 
pass transformation of the ordinary lead compensation 
function 
pee 
G(p) = —— 

pt 6 


b=; (29) 


In other words, the direct envelope function Gpo of 
this network is supposed to approximate the bilinear 
function of (29). In particular, it is intended that Gpo 
have a dominant zero near —a. In actuality Goo is 
represented by a biquartic function, the poles of which 
are easily determined by using Table I. The numerator 
quartic of Gpo is, however, not factorable; an ap- 
proximate location of the zeros can then be obtained 
by the mapping procedure outlined previously. The 
poles and zeros of (28) are located, respectively, at 


So Dek WV? a? 


§ = — a+ fee — @, (30) 


One now forms the function G(p+ jw.) and sets up the 
equation 


G(p + joo) + K(p)G(p — joc) = 9. (31) 
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For the purposes of the conformal mapping, the “poles” 
are at 


p= —a—jla, + Veo? — a?)) 


kel one 3 BY 
p= —b4+ VP —oftijo. f me 
The “zeros” are at 
p= —at jlo. + Veo? — a?) r 
p= bt VP a8 — jo, So ee 


The loci are shown in Figs. 5 to 7, for the three cases 
030210 =@, ands0> we 

The zeros of Gg are at K = —1, and there are double 
zeros at the origin and at infinity. The zeros of Gp are 
at & =1. In each case there is 


1) One real axis zero slightly to the left of p= —a. 

2) One real axis zero near Re[—)— V/8?—w,? |. 

3) One pair of conjugate complex zeros, the real part 
of which is somewhere between —a and 
Re[—0+-V0?—w2], and the imaginary part of 
which is somewhere between w, and 2. 


The zero-pole constellations of Gp are shown in Fig. 8 
(page 61). In every case, there is one dominant critical 
point, the zero near p= —a. The distance from the ori- 
gin of the other zeros is never less than 6 or w,, which- 
ever is smaller. 

It remains to investigate the effect of shifting the car- 
rier component resolution angle ¢. The unit circle locus 
shown in Fig. 9 was constructed for b>w,. For the other 
cases, b<w,, the unit circle locus is similar in shape. It 
is seen that considerable variations in ¢ hardly affect 
the predominant zero of Gp(p, ¢), which remains near 
p=-—a for 45°<#<45°. Within this large range the 
other real zero is still rather far away. The complex 
zeros move into the right half-plane when ¢ becomes 
somewhat negative, and have moved relatively close to 
the origin by ¢=45°. 

The zeros of Go(p, ¢), on the other hand, are quite 
sensitive to small variations in ¢. The zeros at the origin 
move rapidly right and left along the real axis for >0, 
and along the small circle for ¢ <0. The zeros at infinity 
come in as real zeros for ¢>0, and as complex conjugate 
zeros for 6 <0, but they remain at a considerable dis- 
tance from the origin. All zeros are real for 6 >0, conju- 
gate complex for ¢ <0. 


THE SYNTHESIS PROBLEM 


From the foregoing it is clear that an envelope func- 
tion, to be realizable as a linear network, must have one 
of the pole-residue patterns listed in Table I. If it does, 
the network function H(s) can be written down immedi- 
ately from the partial fraction expansion of the particu- 
lar H(p). Synthesis of the network then becomes a mat- 
ter of standard technique. 
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6—Locus of envelope function zeros for double pole. 
—— K>0. 


------- K<0. 
— — — direction of increasing K. 
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Fig. 7—Locus of envelope function zeros for real poles. 
———-— direction of increasing K. 
positive K. 
------- negative K. 


In most practical problems, however, both Hp(p) and 
Ho(p) are specified independently, and they are in gen- 
eral incompatible: that is, they cannot be realized by the 
same network. A common requirement on fg is for it to 
be identically zero, which can be realized only by the 
trivial network H(s)=Ao. In any case, even if the de- 
sired Hp(p) and He(p) are compatible it is unlikely that 
they are realizable because the allowable pole-residue 
patterns shown in Table I are very specialized. Nor- 
mally Hp(p) will be given analytically, or Hp(jwm) 
might be given graphically, and must be approximated 
by a polynomial. In either case, the most commonly en- 
countered form of specification, the first order poly- 
nomial, is not realizable; the next most common one, the 
second order polynomial, is allowed only in a very 
limited way. It can therefore be stated that a realizable 
set of conditions on both Hp(p) and He(p) is never en- 
countered in practice. Actual synthesis problems there- 
fore can never be solved except by some kind of approxi- 
mation. 

A somewhat different approach to the synthesis pro- 
cedure has been described by Hellerman.!! He requires 
the availability of a quadrature input signal, 7.e., a signal 
with the same modulation as the original signal, but on 
the quadrature carrier. Each of these signals is then 


_ 1H. Hellerman, “Transfer functions for amplitude-modulated 
signals,” AJEE Trans., vol. 74, pt. 3, pp. 729-731; January, 1956. 
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Fig. 8—Zero-pole constellations for direct envelope function of lead 
network 


s§ + 2as + w,? 


G(s) = 


(a) CbE< ease (bD)he—"ae. (O) 2 Star. 


Fig. 9—Locus of envelope function zeros with carrier resolution 
angle ¢. 
Zeros of G,(p, ¢) at 6=2¢. 
Zeros of Go(p, ¢) at 0=2¢—T. 
——— locus of | K,/*| =1, direction of increasing 0. 
—-— — locus of K real, direction of increasing K. 


passed through separate linear networks Hp(s) and 
Ho(s), and the responses are added to form a single 
modulated output signal with zero quadrature. The re- 
lationship between the network functions Hp(s) and 
Ho(s) and the specified envelope function Hp(p) is 
shown to be! 


Hy(s) 


34) 
Ha(s) 


= Re Hy (p a 
Im Hp(p — jwe)) 
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Hellerman proves that both Hp(s) and Ho(s) are realiza- 
ble, provided that Hp(p) is realizable as a “low-pass 
prototype” network. Again, from a practical point of 
view, such a quadrature signal is not available. The use 
of just a single network Hp(s) then again constitutes 
some kind of approximation. 

Historically, all attempts at a logical, direct, synthesis 
procedure have faltered at this point. A possible reason 
for this failure is that approximate solutions to the syn- 
thesis problem, derived more or less intuitively, appear 
to work satisfactorily. An excellent review of this ap- 
proach to envelope network synthesis is presented by 
Blanton.” In order to obtain an identically zero quadra- 
ture response, the network H(s) must have the property 


Hj(we + &m)] = H*[ jc — om)]. (35) 


In other words, the amplitude response must have sym- 
metry about the carrier frequency, while the phase re- 
sponse must have skew-symmetry about its value at the 
carrier frequency. The ideal network function then has 
a frequency response like that of a physically realizable 
network but shifted along the frequency axis by an 
amount w,; such a function is not realizable except for 
the trivial w,=0. There does exist a realizable frequency 
shift or transformation, namely the low-pass band-pass 
transformation." If Hp(p) is realizable as “a low-pass 
prototype” network, H(s) is obtained immediately by 


setting 
p a 1 (- L “). 
We DENG. Ss 

Each capacitor in the Hp(p) network transforms into a 
parallel LC in the H(s) network and each inductor in 
Hp(p) transforms into a series LC in H(s), with both 
LC combinations resonant to the carrier frequency. The 
frequency response curves of these transformed func- 
tions, however, do not show the required symmetry un- 
less a logarithmic frequency scale is used, that is, they 
exhibit geometric rather than arithmetic symmetry 
about the carrier frequency. The difference between 
arithmetically and geometrically symmetrical character- 
istics vanishes as the origin of symmetry is approached, 
hence the designation “narrow-band approximation” for 
this design procedure. The networks are also called 
“narrow-band networks,” even though it soon appears 
that reasonable Q's or RC realizability require wide- 
band networks, in the sense that relative bandwidth is 
defined as the ratio of a critical envelope frequency (say 
the frequency of maximum phase lead) to the carrier 
frequency. 


(36) 


2H, E. Blanton, “Carrier compensation for servomechanisms,” 
J. Franklin Inst., vol. 250, pp. 391-407, 525-542; 1950. 

1 PR. Aigran, B. R. Teare and E. M. Williams, “Generalized 
theory of the band-pass low-pass analogy,” Proc. IRE, vol. 37, pp. 
1152-1155; October, 1949. 

4G. Weiss, “Carrier Frequency Networks,” Microwave Res. 
Inst., Polytechnic Inst. of Brooklyn, Brooklyn, N. Y., Rept. No, 
R-701-58, PIB-629; January, 1959, 
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It is only recently that Levenstein® has shown that 
the synthesis of envelope networks can be treated in a 
fashion analogous to the approximation problem of 
classical network synthesis. 


THE APPROXIMATION PROBLEM 


A direct and logical attack on the approximation 
problem is to approximate the function to be synthe- 
sized by one or more of the realizable functions given in 
Table I. This involves several undetermined coefficients 
which can be selected in such a way as to optimize the 
approximation.$ 

The steps in the approximation procedure are analo- 
gous to those used in classical network synthesis: 


1) Approximate the specified Hp(p) by a function 
having the permissible pole-residue pattern (see 
Table I). 

Compute the He(p) corresponding to the selected 
Hp(f). 

Optimize the parameters of the selected Hp(p) to 
minimize the difference between the actual and 
desired Hp(p) and Hoa(p), based on a preselected 
“goodness” criterion. 

Derive H(s) from the optimized Hp(p). 
Synthesize the network form H(s) by conventional 
circuit synthesis. 


2) 


3) 


4) 
5) 


The first step, the selection of a permissible pole- 
residue pattern, immediately determines the type of 
network. Approximation of Hp(p) by conjugate com- 
plex poles (line 6, Table I) leads to real poles of H(s) 
which permits synthesis by RC networks. Approxima- 
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A Low-Pass APPROXIMATION 


It is desired to synthesize a network function H(s) 
which approximates a prescribed direct envelope func- 
tion Hp(p) and a prescribed quadrature envelope func- 
tion Ho(p)=0. The actual envelope functions will be 
designated Hp’(p) and Hg’'(p), respectively. An error 
function Ep(P) is defined 


Ep(p) = Hn'(p) — Ho(?). (37) 


The design procedure will be illustrated for the simple 
pole 


pth 


Table I indicates that such a function is not realizable, 
and the first step is to approximate it by a realizable 
function Hp’(p). One might select Hp’(p) from line 6, 
as a conjugate pair. Or one might select an approxima- 
tion in the form of three poles, line 8, as was done by 
Levenstein. The procedure to be followed will be to 
select the most general approximation, the quadruplet 
of poles, line 7. Hence 


Hy(p) = (38) 


; 3(A + 7B) 3(A — 7B) 
Hp'(p) = rise vie 
pt+é =D. — koe) pt+o + j(D — we) (39) 
2(A + 7B) 2(A —jB) 
pb — 7(D--a.)" p07 (De) 


where there are four undetermined real coefficients, the 
pole parameters b’ and D, and the residue parameters A 
and B. From Table I the corresponding quadrature 
function is 


HQ'(p) 


tion of Hp(p) by triplets and quadruplets (lines 7 and 8, “y 2j(A + 7B) 2j(A — 7B) 
Table I) leads to complex poles of H(s) and RLC net- ie pte —j(D—w) p+0' + 9(D—~«,) 
works. ve : Sey oy ieee 
The “error” criterion or “goodness” criterion chosen ai(A ase ae Ace) (40) 
to optimize the selected Hp(p) will determine the de- PRD Da) > ep AOE gD Fae) 
tailed structure of the network and its parameter values. ACR eee dj Roney ae 
It will be shown how a particular set of optimization pte igh Oo aan pace pees edeas SP 
criteria leads to the conventional low-pass band-pass A — 7B A+ 7B 
as H(s) = ae (41) 
approximation, and at the same time to the currently Re eS, ae 
j Side be og) 
used RC lead networks. Thus the whole field of en- 
velope networks is unified. Simplifying these expressions, one obtains 
ie + (3Ab’ — BD)p? + |A(3b2+ D? 4+ w,2) = sed 
+ [Ab'(b? + D? + w.2) — BD(b’ + D — w,2)] 
Hp'(p) = 2 7 ; A (42) 
[(p + 6° + (D — w.)*][(p + 6)? + (D + @,)*| 
Eas —2we{ Ap? + 2(Ad’ — BD)p + [A(O? — D? + &2) + 2'BD]} 
Q a ; ; 43 
[+ 4)? + (D — w)?*][(p + 0/)? + (D + a.)?] ‘o 
2[ As + (Ab’ — BD)| 
H(s) = (44) 
set 2b's 4-(b--D*) 
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One now proceeds to select parameters so as to mini- 
mize He'(p). In a low-pass system, like the usual servo- 
mechanism, it is plausible to minimize Hg’/(p) at p=0. 
The numerator of (42) is a quadratic, hence there exists 
the possibility of obtaining a double zero at the origin; 
in other words, both the quadrature function and its 
derivative are made to vanish at zero modulating fre- 
quency. This result is obtained by setting 


Ab’ — BD=0 
A(b — D? + a”) — 26'BD = 0. 


(45) 

(46) 

Simultaneous solution of these two equations yields 
NEES pe ae (47) 


so that the network is tuned to the carrier frequency. 
The relation (45) also simplifies the network (44) by 
eliminating one numerator term 


DAS 
s? + 20's + w? 


Since the parameters b’, D, A, and B are all real, the 
relationship (46) implies w.>b’. Thus the network func- 
tion has complex poles and is realizable only by RLC 
networks. 

Consider instead the case w,.<b’, that is, D and B 
imaginary. Let D=jD, B= —jB. This is equivalent to 
starting out with a quadruplet 


its) = (48) 


2(A — B) z(A — B) 
Hp'(p) = : : : 
PD p— Don. pt be Dt Jeg 
(A +B) eee as 
Cote — jaas Pp - 0 aD 7. foe 


In other words, Hp(p) is now approximated by two 
conjugate complex pairs, see Table I, line 6. The poles 
‘of H(s) are now real, and realization by RC networks is 
possible. From the table the corresponding quadrature 
function is 
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These expressions can again be simplified to expressions 
resembling (42)—(44). Minimizing the quadrature at 
p=0, one obtains 


Ab’ — BD=0 
AG Aegp a k= Bh D0, (52) 
So that 
OM Drea? (og, <b") (53) 


and the network is again tuned. For either case one ob- 
tains 


2A (p3— 20! p2+ 2u.2p+2b'w.2) 


Hp(p)= ia Rua ar eT ae je 
p+ 40'p3+4(b+a,") p?+ 8b'w.?p+4b'w.? 
; —2w,A p? ae 
Hq (p) . 4 Al 19 ; 2\ 22 5 rs (55) 
pit 4b’ p?+4(b?+ w,”) p?+ 8b'w."p+4b'w," 
and 
2As 
His) = (56) 


gs? + 26's + w,? 


The preceding optimization procedure for minimum 
quadrature establishes the pole pattern of the functions 
H(s), Hp'(p), and Ha’(p). The pole locations are tabu- 
lated in Table II for the three cases b’<w, b’=w, and 
b’>w,.. A straight-forward geometric construction can 
be set up. The poles of H(s) are located, for b’<e,, on 
the circle of radius w, with center at the origin; for 
b’>w., these poles are of course on the real axis. The 
poles of the envelope functions, for b’<w,, are located 
on two circles of radius w., with centers at (0, +7w,); for 
b’>w,, these poles are located on the circle of radius b’ 
and center at (—0, 0), and its intersection with the 
horizontal lines s= +jw.. The poles will travel along 
loci when the relative values of b’ and w, are changed. 
Fig. 10 shows the loci of the poles for fixed carrier fre- 
quency and varying b’. 

Of the four undetermined coefficients, two, namely 


4d (A — B) ce (A — B) B and D, have now been selected. To select the remain- 
: 2 ing coefficients, A and B’, the error function Ep(p) is 
pa?) p+ — D— ju. f) pt’ — D+ jue now minimized. Substituting (38) and (54) into (37), 
(2A — K)p* + 2[A(o + 20’) — 20'K]p? + 4[A(w.? + bb’) — K(we? + eal 
“ { + 4w,2[A(b + b') — 2b'K]p + 4b’a.2(Ab — b'K) 57) 
ies (p + b)[pt + 40'p? + 4(w.2 + 6) p? + 8b'w.2p + 46-7] 
ii hi ese Minimizing this function and its first derivative at p=0 
eae ag + B) . wdc 
——______ — a= (80 
Be ar ORT pty+ D+ jo Ab — 0'K =0 
; ; Ware Onn 
and the corresponding network function is ON ta 1 NY) (58) 
; Aes AB hence 
= - . 51 
H(s) yee ene D (51) Anon Nae aS (59) 
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PoLE LocATIONS FOR ENVELOPE NETWORK FUNCTIONS OPTIMIZED FOR MINIMUM QUADRATURE 
(“TuNED” NETWORKS) 


poles of H(s) poles of Hp(p) and Ho(p) 


bY < we Ua 0 — B+ 5 (Va? — 6” + wx) 
= 6 +i (n/act — 6 — we) 
=U joe b" — b! ~j (Vad — 6 — w) 


= p—j/ot = pi + ¢) 


b’ = we — w, (double) — we + jw, (double) 


— we — jw, (double) 


b’ > we Bees NA eg (— bY + Vb" — w.*) + joe 


(= Bi 4p 4/0? =e?) = Jue 


— b! — Vb? = wo? (= 8 = 09 =) fee 


(= b! — /b — @,2) — jus 
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Fig. 10—Pole loci of H(s), Hp(p) and He(p) after quadrature 
optimization (“tuned” networks). 
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so that 
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K(p + 26)p* 


Ep(p) 


As a result Ep(p) has a triple pole at the origin, the 
function itself and its first two derivatives vanish at 
p=0. One also obtains 


2K (p3 + 2bp? + 2w2p + 2bw.2) 


Hn (p) > — TSE rel 
p* + 4bp* + 4(w,? + b*) p? + 8bu.2 + 4b?w,? 
; 1 Kexp2 
Ha'(p) = eee 2/62) 
pi + 4bp? + 4(w.? + b?) p? + 8bu.2p + 4b?w,? 
2Ks K 
EAS) = is - (63) 
s? + 2bs + w,? We [1S We 
“(<4 ")+0 
2 Nbc K) 


The relationship between Hp(p), (38), and H(s), (63), 
is exactly that given by the conventional low-pass band- 
pass transformation. This correspondence can also be 
shown for other forms of Hp(p), the linear polynomial, 
a complex pole, repeated poles, etc.™ 

The approximation method here presented does not 
immediately yield new networks useful in control engi- 
neering practice. It does show, however, how the cur- 
rently used networks are derived, how they fit the de- 
sired specification. In particular, it is seen that the con- 
ventional RC and RLC networks are both obtained by 
the same approximation procedure, and are represented 
by the same algebraic function; RC networks are ob- 
tained for particular pole locations of this function. 


NUMERICAL EVALUATION 


The error functions Hg’ and Ep have multiple zeros 
at the origin, hence one might expect that the approxi- 
mation is much better than the term “narrow-band 
approximation” would lead one to believe. This is in- 
deed the case, as the following numerical example will 
show. Consider the lead network specification 

Re. 
Go(p) > des it Naa 
p+ 6 prs 
The values of Go’ and Ep are obtained by substituting 
(a—b) for K in (62) and (60); the value of Gp’ is ob- 
tained further by adding unity to (61). All these func- 
tions can be evaluated at real modulating frequencies, 


a<b. (64) 


| p= jem. au 
It is convenient to introduce the normalizations 
a . 
a = — = gain at zero modulating frequency, 
b 
ab 
B= me = relative bandwidth of network, (65) 
We 
Wm . : | 
4 = —_~ = normalized modulating frequency. 
4 /ab 


(p+ d) [pt + 4bp + A(we? + 0°) p? + Sdarp + 46%,2] 


(60) 


The functions have been evaluated for a low-pass proto- 
type designed for a maximum phase shift of 41.8° at 
26.8; cps, (@=0:2, @=12 cps; .b=60 cps). Two carrier 
frequencies are considered, 60 cps and 400 cps. The 
choice of a 400-cps carrier (8 =0.0671) would result in a 
moderate bandwidth system. The choice of a 60-cps 
carrier (G=0.447), on the other hand, results in an ex- 
tremely wide-band system; in fact, b=w,, so that the 
resultant network will have a double pole on the nega- 
tive real axis. 

The characteristics of the narrow-band network (400- 
cps carrier frequency) are plotted in Fig. 11. The ap- 
proximation to the desired direct envelope function is 
within 0.4 per cent over the range of modulating fre- 
quencies of 0-60 cps; it is perfect for all practical pur- 
poses. The magnitude of the quadrature term is less 
than 4 per cent of the direct term. For the wide-band 
case (60-cps carrier frequency), the functions are plotted 
on Fig. 12 in polar form, with the relative modulating 
frequency u as parameter. The approximation is not as 
good, the error in the magnitude of the direct function 
becoming as large as 11 per cent; the quadrature func- 
tion is 40 per cent of the desired direct term for the range 
of modulating frequencies previously considered. From 
a practical engineering point of view, the approximation 
to the direct function is satisfactory at all modulating 
frequencies. The important criterion here is the phase 
angle of the direct function. Below «=0.7 the phase of 
Gp’ leads the phase of Gp by about 0.1°. The two loci 
then intersect, and Gp’ begins to lag Gp. At u=1 this 
lag is only 0.6°, and it does not become 10° until w= 1.72. 
It would appear that this phase lag at high frequencies 
can easily be taken care of by overspecifying the re- 
quired phase angle. In any case the example here con- 
sidered is an extreme one. 

The approximation to the quadrature function is not 
so good. When the ratio |Ge/Go| is 0.4, any system 
error already existing due to the combination of a quad- 
rature signal plus a phase misalignment as small as 10° 
will be tripled. However, Ga is zero at zero frequency so 
that the quadrature error is not significantly increased 
under steady-state conditions. Under dynamic operat- 
ing condition the quadrature error due to the network 
may be considerable, which emphasizes the importance 
of minimizing both quadrature noise and demodulator 
phase misalignment. 

Another way of looking at the approximation error is 
to evaluate the functions at «=1, the frequency of 
maximum phase lead for the low-pass prototype. This 
is done in Fig. 13 for three different values of a. It is 
seen that the difference in phase lead between the actual 
network and the low-pass prototype rarely exceeds 5°. 
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Fig. 11—Approximation function Ep(jwm) for narrow-band case 
(400 cps carrier). se 46: 
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Fig. 12—Network functions for wide-band case (60-cps carrier). 
(Parameter is relative frequency “=wm/+/ab). 


Specifications 
Attenuation =5:1 
Lower corner (a) =12 cps 
Upper corner (0) =60 cps 


Maximum phase shift =41.8" at 26.8 cps 
./ab =168.3 rad/sec, B= /ab/we=0.447, w=0.2. 
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ig. 13—Approximation error at @m= Vab(u =1), desired 
frequency of maximum phase shift. 


ea 
9 


CONCLUDING REMARKS 


A reasonably complete theory of network behavior for 
carrier-suppressed modulation is now available, includ- 
ing a logical synthesis method. To a large extent, how- 
ever, the theory and particularly the synthesis method 
are academic; the only practical network which can be 
synthesized for conventional servo compensation is the 
bi-quadratic lead network. The bi-quadratic lag net- 
work is impractical because of the fantastically large 
coil Q’s required; higher order functions are impractical 
because several tuned circuits must be kept aligned. 
This whole formidable theoretical apparatus is then 
used to derive just one single network. To all this must 
be added the problem of carrier frequency drift. 

On the positive side, there now exists a sound basis for 
the empirical methods developed in the past. The so- 
called “narrow-band” approximation concept is seen to 
be a misnomer on more than one account. First, the 
approximation is excellent over a wide frequency band; 
secondly, realizability requirements demand a network 
with frequency dependence stretched out over a wide 
band of frequencies. “Low-pass approximation” would 
be a better designation. 
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Design Aspects of Attitude Control Systems’ 


M. F. MARX+ 


Summary—Figures of merit, besides those of performance, are 
discussed relative to the attitude control system of a vehicle capable 
of leaving and returning to the atmosphere. In addition to extreme 
changes in flight condition, these applications are subject to varia- 
tions in configuration and performance requirements. 

Traditionally, control optimization has been concerned with mini- 
mizing or maximizing a variable system function such as error. Quite 
often these error criteria are replaced by other criteria such as in- 
variance and the capacity for adaptability. In fact, during a complete 
mission including exit to re-entry it is desirable to utilize variable 
figures of merit. 

Examination of the control requirements of a modern returnable 
space vehicle illustrates how the various figures of merit dictate the 
design configuration. In those phases of the mission where self- 
adaptive control is employed, the figure of merit is usually deter- 
mined by the particular technique selected. It is further demon- 
strated how the figure of merit varies with the mission phase as the 
control actuation configuration changes. 


I. INTRODUCTION 


7 |) NHE literature of recent years contains much in- 
|e concerning elements needed to synthe- 
size attitude control systems. Much progress has 
been made along the lines of control system techniques, 
particularly in the areas of optimum and self-adaptive 
techniques. The pursuit of knowledge in these areas has 
done much to refine methods of analysis of linear and 
nonlinear systems. 

Parallel efforts have been made in the fields of actua- 
tion or “muscles” and sensors for attitude control sys- 
tems.' Methods are available for the application of con- 
trol torques ranging from several inch-ounces to many 
foot-pounds. 

This paper indicates some of the trade-off studies 
which are necessary to select the actuation means, the 
sensors, and the computations required to achieve satis- 
factory attitude response. With the large store of in- 
formation available on actuation and control techniques 
the proper choices are not simple. The fact that many 
modern vehicles, particularly those of the space variety, 
span large performance ranges results in a requirement 
for the combination of more than one attitude system 
and for methods to switch control from one system to 
the other. 

One reason for preparing this paper is to focus atten- 
tion on the many factors leading to the control con- 
figuration besides performance. The procedure adopted 
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by a number of investigators has been to select a per- 
formance criterion or figure of merit such as a mean- 
square error criterion and then by analytic means to 
derive a system which satisfies this criterion. The sys- 
tem which best satisfies the selected criterion is, by 
definition, optimum. If this approach is adopted, it is 
evident that the performance criterion, in reality, de- 
termines the system configuration. But who is to say 
that the proper performance criterion has been selected ? 
It is hoped that the examples contained herein will point 
out additional considerations which may be useful in 
arriving at the optimum performance criterion. 


Il. Misston PHASES 


For purposes of illustration, an arbitrary mission 
which is broad enough to encompass the major control 
types has been selected. It is assumed that the attitude 
control system for a recoverable glide vehicle having 
orbital capability must be synthesized. The mission 
phases of the example selected are: boost, orbit injec- 
tion, orbit, orbit ejection, re-entry, and landing. Fig. 1 
presents the mission phases in terms of the flight path. 
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Fig. 1—Mission phases in terms of the flight path. 


Using currently available booster fuel and engine 
combinations, and realizing that a gliding, recovery 
vehicle most likely will be manned, we can safely assume 
that at least three vehicle stages will be required to 
achieve orbit velocity (approximately 25,000 feet/sec 
for 200-mile altitude). The first stage is employed during 
the boost phase. The next stage and possibly also the 
third stage are required to achieve orbit velocity of the 
payload (the gliding vehicle). The orbit phase for this 
generalized example involves an indefinite number of or- 
bital revolutions around the earth; a specific mission 
would dictate the orbital life and the attitude reference 
and accuracy requirements. Orbit ejection is concerned 
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with the alignment required for retrorocket firing; an 
energy management computer determines the firing 
point and the total impulse required to achieve the orbit 
transfer enabling satisfactory recovery. The re-entry 
phase of the mission deals with the altitude velocity re- 
lationships enabling satisfactory descent considering 
heating, acceleration, and range capability. Landing 
deals with the vehicle control after passing through the 
altitude velocity corridor; in this region, the heating 
danger is over and the control problem is more or less 
that of a conventional airplane with or without thrust 
capability utilizing aerodynamic control surfaces for 
actuation. 


III. AttituDE ConTROL DuRING Boost 


During the boost phase, the vehicle configuration is 
similar to that presented in Fig. 2. 

Neglecting speed changes, the vehicle short-period 
transfer function in pitch can be written 


6 Ko(1 + sT) 
6 


gs? 
aga ste sr L 
w w 


where 


6=short-period pitch rate, 
K,=short-period gain, 
7,=path time constant, 
w =short-period resonant frequency, 
¢=short-period damping ratio, 
s= Laplace differential operator. 


This approximate representation of the vehicle dy- 
namics has been selected in order not to obscure the dis- 
cussion which follows. Although considerably simplified, 
it is a fairly good description if large angular rates and 
linear accelerations are avoided. 

Considering the case immediately after lift off when 
the aerodynamic forces are negligible, the pitch rate 
transfer function degenerates to 


As the velocity increases, the frequency and damping 
terms begin to appear in the transfer function. For the 
configuration shown in Fig. 2, the vehicle is statically 
unstable and is said to have a negative stability margin. 
The transfer function typically becomes 


6 Ko(1 + sTe) 


eo) Ue) 
i T> 
The interesting point to the control designer is that 


the process is dynamically unstable. Although the con- 
figuration can be stabilized by simple rate feedback, the 
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Fig. 2—Vehicle configuration during boost phase. 

y=Flight path angle measured from the reference trajectory 
L=Aerodynamic lift 

D=Aerodynamic drag 
W =Vehicle weight 

T =Engine thrust 

6= Deflection of the thrust vector 

6= Pitch angle 

a=Angle of attack 

C.G.=Vehicle center of gravity. 


response in general cannot be made sufficiently fast to 
assure adequate path control. 

Before considering further the required feedback 
form, several additional elements of the open-loop trans- 
fer function will be discussed. If thrust vector control is 
achieved by means of a gimbaled engine, the dynamics 
of this actuation should be included. Usually a simple 
first-order lag with time constant 7’, is adequate for this 
representation. To be realistic the effect of vehicle 
elasticity must be included. According to Beharrell and 
Friedrich? this adds a quadratic lead-lag term to the 
short-period transfer function. The combined root-locus 
plot for attitude rate is shown in Fig. 3. (Although it is 
desirable to control attitude, rate is discussed since sat- 
isfactory rate control is required to obtain satisfactory 
attitude response.) 

The pole-zero combination shown is representative of 
the first bending mode of the vehicle. The higher modes 
can be shown to add additional pole-zero combinations 
which have been omitted for purposes of simplicity. 
Quite often the first bending mode of a large booster 
configuration results in structural resonance in the 
neighborhood of 2 to 3 cps. If control mode resonance of 
0.5 cps is desired, it is evident that a challenging control 
problem exists. 

To further complicate matters, the process is not in- 
variant. The large amounts of fuel utilized during boost 


* J. L. Beharrell and H. S. Friedrich, “The transfer function of a 
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Fig. 3—Combined root-locus plot for attitude rate. 
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Fig. 4—High-performance rate system. 


and changes in flight condition result in significant 
variations in the structural resonance and in the time 
constants 7», 7, and 7) associated with the rigid vehicle. 
Changes in payload usually result in similar vehicle 
transfer function changes. 

For any fixed set of conditions the control mode must 
be stabilized by the addition of lead. Fig. 4 indicates a 
feedback configuration which accomplishes this func- 
tion. An angular accelerometer or lead network is re- 
quired to provide the necessary lead. 

With this feedback configuration, the root locus 
shown in Fig. 3 changes to that shown in Fig. 5. The 
complex zeros in the feedback are determined by the 
values selected for K,, 73; and 74. Error integration has 
been added to provide zero error steady-state response. 
Steady-state torque perturbations resulting from thrust 
misalignment and aerodynamic forces require this addi- 


tion. 


The resulting attitude control system is conditionally 
stable with respect to the structural mode. As the open 
loop-gain is increased from zero, the structural mode be- 
comes unstable and again stable. If the gain is suff- 


ciently high the structural mode will be essentially 


eliminated from the response and the closed-loop con- 
trol mode transfer function will approach the inverse of 
the feedback. Thus the desired closed-loop dynamics 
can be obtained by the proper combination of feedback 
gradients provided the open-loop gain K is sufficiently 
high. 

The system described in Fig. 4 can easily be made 
self-adaptive by monitoring the frequency associated 


with the actuator and filter time constants deeds das 


of Attitude Control Systems 


69 


5) l 
IMAGINARY 


REAL 


Fig. 5—Root-locus plot—feedback configuration. 
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Fig. 6—Self-Adaptive rate system. 


respectively.*® Fig. 6 indicates the location of the gain 
changer shown as a multiplier. 

Since the high-frequency mode is monitored, it is de- 
sired to monitor the system where this mode is pre- 
dominant. A filter has been added ahead of the fre- 
quency sensor to attenuate the low-frequency com- 
ponents due to the control mode. If the frequency of the 
actuator mode deviates from the center frequency of the 
frequency sensor, the integrator output will cause the 
multiplier to change the gain so as to restore the center- 
frequency operation. Normally the center frequency is 
set as high as practical so as not to excite higher-fre- 
quency modes not shown in the representation. Thus the 
highest possible open-loop gain is maintained and the 
desired response obtained. 

A continuous proportional system has been selected 
for control in the booster phase. The criterion selected is 
invariant response in preference to the error criteria dis- 
cussed in the literature in connection with optimum 
controls and a number of the self-adaptive techniques. 
The primary reason for this choice is the need to tie-in 
with the guidance system which results in additional 
loops being used around the attitude control. This tie-in 
is greatly facilitated if the inner loops are invariant. 


3M. F. Marx, “Recent adaptive control work at the General 
Electric Company,” Proc. Self-Adaptive Flight Control Systems Symp., 
January, 1959. 
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The continuous system choice is predicated on the 
presence of the lightly damped structural mode which 
would be needlessly excited if a discontinuous system 
having a limit cycle were employed. 


IV. ATTITUDE CONTROL DURING ORBIT 


Upon achieving orbit the propulsion stages are as- 
sumed to have separated so that all that remains is the 
payload, which is the return component with a winged 
configuration. If the vehicle is manned, it is likely that 
the orbit will be above 100 miles altitude to be free of 
aerodynamic drag and under 300 miles to be clear of the 
Van Allen radiation belts. 

For purposes of illustrating the attitude control de- 
sign features, it is assumed that the satellite functions 
require it to preserve a fixed orientation with respect to 
earth vertical. This could be for reasons of communica- 
tion, surveillance, or meteorology. It is further assumed 
that the attitude errors should be held to +0.1° of arc. 
Regarding accuracy of control, there have been specifi- 
cations which have required attitude errors to be held 
under 0.1 second of arc. Hence it is seen that the pres- 
ently assumed 0.1° specification is quite modest, rela- 
tively speaking. 

Since it is required that the vehicle be slaved to the 
earth’s vertical and the orbiting altitude lies between 
100 and 300 miles, the satellite will require nearly con- 
stant angular rotation at about 4°/minute. The orbit 
altitude restraint requires a nearly circular orbit. Since 
the orbit cannot be made exactly circular, there is cer- 
tain to be some orbital eccentricity. Due to this eccen- 
tricity, the satellite angular velocity will require that a 
sinusoidal component having a period of approximately 
90 minutes be superimposed on the constant 4°/minute 
average rate. Hence the attitude control will be active 
for the entire mission phase. 

In addition to the varying attitude system command 
caused by eccentricity of the orbit, disturbing torques 
due to gravity gradient, magnetic fields, solar pressure, 
motion of inhabitants and machinery, and aerodynamic 
torques from residual atmosphere require trim torques 
from the actuation means. 

An additional important consideration entering into 
the design of the orbit attitude-control system is weight. 
Considering that it takes approximately 100 pounds of 
booster weight for every pound put into orbit, a trade- 
off study between the total control weight and the 
weight of the power supply must be made. 

The inertial actuation means in the form of power 
gyros and flywheels are attractive considering the cyclic 
angular rate requirement resulting from orbit eccen- 
tricity. In this event the momentum interchanges be- 
tween the vehicle and flywheel result in no net power 
requirement except that to compensate for motor and 
friction losses. If the flywheel must supply a trim torque 
it must be periodically reset by an additional torquing 
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device such as a mass expulsion system. Hence, it is seen 
that the flywheel plus the required reset feature requires 
considerable weight but is capable of economical opera- 
tion in terms of fuel requirement. This may be an im- 
portant consideration for an unmanned satellite having 
a lifetime measured in years, but in the case of a manned 
vehicle where duration is relatively short, v7z., several 
days, the fuel requirement assumes a less important role. 

The mass expulsion techniques such as gas reaction 
jets are extremely small and reliable but require ex- 
penditure of fuel mass to change the vehicle momen- 
tum. As an indication of size requirements, these units 
are commonly calibrated in inch-ounces. Since the re- 
sulting nozzle sizes must be extremely small if propor- 
tional control is utilized, it is advantageous to modulate 
with timed impulses so that relatively large jets can be 
used to develop the required impulse. These larger jets 
are less prone to plugging than the smaller jets needed 
for proportional control. 

The timed impulse technique is well suited to the va- 
por-pressure type gas generator which recharges itself 
using solar energy. The size of the generator depends on 
the duty cycle to which the control is exposed and the 
perturbation torques encountered. 

The other consideration which leads to the timed im- 
pulse method as an attractive choice in this application 
is that of sensor deadband which leads to unstable 
operation within the deadband. This is particularly a 
problem regarding the rate stabilization signal. At the 
low rates encountered with these controls it is exceed- 
ingly difficult to obtain rate sensors with thresholds low 
enough to sense the motion. Hence, the control tech- 
nique which provides adequate stability without re- 
quiring rate is desirable. 

The timed impulse technique accepts the fact that the 
system will limit the cycle, and uses it to full advantage. 
Through suitable logic the correct impulse can be ap- 
plied to reverse angular direction at the switching 
boundary, even in the presence of a trim torque. The 
switching boundary is determined by the over-all ac- 
curacy requirement of the attitude control. 

In addition to the difference in force levels and speed 
of response, another important difference between the 
orbit and booster control phases relative to attitude 
control is the difference in requirements for feedback 
parameter variations. While the vehicle is in orbit, the 
very low aerodynamic forces and the low angular rates 
involved make the attitude control essentially inde- 
pendent of velocity. Furthermore, the low fuel expendi- 
tures result in negligible changes in the vehicle total 
mass and mass distribution. Hence the vehicle’s transfer 
function is virtually invariant, thus obviating the neces- 
ity of a self-adaptive system. This being the case, such 
factors as orbit duration, accuracy requirements, system 
weight, and reliability are the items which lead to the 
formulation of the system configuration. 
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V. ATTITUDE CONTROL DuRING RECOVERY 


These phases of the mission result in still another 
form of attitude control having characteristics some- 
what similar to the booster phase but entirely different 
from the orbit phase. These differences are apparent if 
one reviews the general concept of the recovery of a 
lifting vehicle. 

Orbit ejection is a form of orbit transfer where the 
transfer is from the circular or slightly elliptic orbit to a 
parabolic trajectory prior to reentry into the earth’s 
atmosphere. This orbit transfer is accomplished by the 
proper application of a thrust impulse of sufficient mag- 
nitude and direction to impart the desired velocity in- 
crement to the vehicle. The size of the velocity incre- 
ment is derived from an energy management computer 
which is discussed subsequently. 

During the orbit ejection phase of the mission the at- 
titude control serves to align the vehicle prior to and 
during the firing of the retrorocket used to impart the 
required velocity increment. Whether a radial or tan- 
gential firing technique is employed is immaterial to this 
discussion since accuracy and force-level differences are 
not sufficiently large to determine the attitude control 
technique. 

The performance specifications on the attitude control 
depend on the allowable variations in magnitude and 
direction of the desired velocity increment used for 
ejection. This increment is dictated by the type of re- 
entry employed by the re-entry computer. Generally 
speaking, attitude control requirements prior and during 
retrorocket firing are in the neighborhood of 0.1°. If the 
vehicle is slaved to the earth’s vertical during orbit there 
is no firm requirement for large slewing rates, but the 
control must have adequate authority to compensate 
for variations in thrust direction and displacement rela- 
tive to the center of gravity of the vehicle. These thrust 
asymmetries usually range within 0.1° in alignment and 
0.1 inch in displacement depending on the engine size 
and design. Engines utilizing solid propellants are usu- 
ally more difficult to align than those employing liquid 
propellants. 

The trim requirements due to thrust misalignment 
result in an attitude control whose authority is several 
orders of magnitude larger than that required for orbit 
control where the perturbations are infinitesimal in com- 
parison. 

At this point it is reasonable to question why this 
powered phase should be different from the boost phase. 
The difference is that during ejection the thrust is ap- 
plied for a relatively short time after which a ballistic 
trajectory is followed prior to re-entry. The rest of the 
flight, at least for presently contemplated designs, is un- 
powered due to weight restrictions. Hence, the high- 
level control used for orbit ejection will also be used for 
alignment prior to re-entry where dynamic pressure is 
too low for aerodynamic control. Later in the flight 
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after dynamic pressure is sufficiently high, aerodynamic 
actuation is feasible. 

As indicated previously, the recovery attitude-control 
accuracy specifications are determined by the energy 
management computer which for this discussion can be 
viewed as a guidance computer. It functions to generate 
the proper steering commands to the control system so 
that the vehicle recovery is made within the constraints 
of allowable heating, acceleration limits of the vehicle 
and inhabitants, and dispersal of the landing sites. Cer- 
tain variations of the problem, such as a minimum time 
recovery and an alternate landing site designation, are 
handled by the computer. 

The computer problem is mainly one of prediction 
due to the limited maneuverability of the vehicle and 
the finite amount of energy associated with unpowered 
flight. Although the energy management computer is 
another subsystem, it is mentioned at this time to point 
out the close relationship between the two systems. One 
cannot be designed without full consideration of the 
other. 

One of the most common high-level nonaerodynamic 
control actuation techniques presently considered is the 
mass expulsion system powered by a cold gas or hot gas 
power supply. The control is required for only a very 
limited time so the hydrogen peroxide systems such as 
employed on the X-15 research airplane or the ammo- 
nium nitrate powder grains offer neat light packages. 

The use of hot gas power supplies transfers the design 
problem to the systems engineer. Due to contamination 
and high temperature it is difficult to modulate the high- 
level controls to obtain proportional action and next to 
impossible to throttle to zero. For these reasons the dis- 
continuous control techniques employing base-width 
pulse modulation or conventional relay control are 
suitable. As an example of the later technique, the 
schematic shown in Fig. 7 illustrates such a mechaniza- 
tion.4 
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Fig. 7—Discontinuous control technique. 


These systems are characterized by a limit cycle due 
to the dead zone of the relay or bistable element. They 
are sometimes referred to as hysteresis systems. The 
limit cycle amplitude and frequency are functions of the 
open-loop gain and lead obtained from the rate feed- 
back. The hysteresis of the relay is usually a destabiliz- 
ing factor. Stability analysis of these systems is com- 


4R. L. Cosgriff, “Nonlinear Control Systems,” McGraw-Hill 
Book Co., Inc., New York, N. Y.; 1958. 
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monly carried out employing phase plane techniques if 
the system order is not greater than two. Higher order 
systems necessitate the use of phase space techniques. 
These procedures, however, are so hard to visualize, that 
computing facilities are usually utilized in these in- 
stances. 

The high-level controls used in recovery generally re- 
flect the use of techniques different from the timed im- 
pulse method formed in the low-level orbit controls. The 
control mode frequencies are typically in the range of 
three to six radians per second. Consequently, rate gyros 
or lead networks can be successfully applied as in con- 
ventional flight control applications. 

Earlier in the discussion it was mentioned that. the 
first part of the recovery required the use of nonaerody- 
namic control until sufficient aerodynamic control was 
available so that aerodynamic control surfaces regulated 
by a self-adaptive control system could be used. It is 
desired to make the changeover to aerodynamic control 
as early as possible in order to minimize the amount of 
reaction fuel required. The change from one control type 
to the other, and their combined use, is called control 
blending. The same problem is encountered in control 
system design for vertical landing or takeoff aircraft 
(VTOL) during transition from hovering to conven- 
tional flight. 

Although blending, when first considered, appeared 
difficult to accomplish automatically, the solution was 
rather simple. Fig. 8 illustrates a combined aerody- 
namic and nonaerodynamic system. 
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Fig. 8—Combined aerodynamic and nonaerodynamic attitude control. 


The aerodynamic control portion of the system is 
similar to that described for booster control. The system 
error € controls the firing of the reaction control. When- 
ever the aerodynamic control loses effectiveness as in- 
dicated by error buildup, the nonaerodynamic control 
activates automatically. It is interesting to note the 
operation of the combined system is such that as the 
least amount of aerodynamic force appears, the effective 
spring constant of the vehicle drives the steady-state 
error signal to zero, thus eliminating the limit cycle of 
the nonaerodynamic system. This operation is highly 
desirable from the viewpoint of control life and fuel 
economy. 

Considering the attitude control requirements of the 
recovery phase, the performance is satisfactory if it ade- 
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quately activates the steering commands generated by 
the guidance system, in this case the energy manage- 
ment computer. Typical requirements of the attitude 
system are zero error characteristics, which imply error 
integration; an equivalent resonant frequency of ap- 
proximately five radians per second; and a damping 
ratio of 0.7. 

As in the case of the booster control, the attitude con- 
trol and guidance system compatibility are important 
considerations. The integration of these subsystems is 
greatly facilitated if the attitude transient response is 
invariant, rather than if it satisfies an arbitrary error 
criterion. 

The absence or presence of atmosphere dictates the 
form of actuation, aerodynamic or nonaerodynamic. 
The form of actuation in turn places constraints on the 
type of system which can be utilized. 

Due to the high rates of response (high compared to 
the orbit phase), there is considerable choice available 
for the generation of an attitude rate signal for stabiliza- 
tion. Hence, in this case, the sensor requirements are not 
strong factors in the design of the attitude system. The 
design of the energy management-computer, however, 
depends strongly on sensor availability. 

Human factors are important aspects of the attitude 
control system design problem. Since the vehicle will be 
under the management of a pilot, the pilot and vehicle 
must be compatible. Generally this places a further spec- 
ification on the system band-pass. Since the pilot’s de- 
sired response can be specified within rather narrow 
limits, invariant attitude system response is desirable. 
A further requirement resulting from the presence of the 
pilot is that of display provision. This aspect, however, 
is a science in itself and is not discussed herein. 

Since during the recovery phase and particularly dur- 
ing re-entry, the vehicle traverses extremely large 
ranges of altitude and velocity in short time spans, it is 
necessary that the control system have the capability 
for making very rapid changes in gain. Although this 
problem is more severe for a ballistic or nonlifting re- 
entry, the gliding vehicle assumed herein also experi- 
ences difficulty. The assumed vehicle attains maximum 
dynamic pressure about thirty minutes after firing the 
retrorocket. Consequently, an adaptive or nontailoring 
system is most appropriate for recovery. 


VI. CONCLUSION 


The attitude control requirements of a manned lifting 
vehicle having orbit capability have been examined. 
Based on the performance requirements, integration 
factors, characteristics of the sensors and actuators, du- 
ration of the mission, perturbations, structural rigidity, 
vehicle size, and reliability, a typical control system has 
been described for the various phases. 

For the particular mission selected, four distinct types 
of attitude control are advisable. During the boost 
phase a continuous information, self-adaptive system 
employing a rotatable rocket engine thrust means is 
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satisfactory. The requirements of the particular orbit 
mission selected can be fulfilled with a mass ejection 
system of low-authority control by timed impulses. Re- 
covery requires the blending of nonaerodynamic control 
of high authority with conventional aerod ynamic control. 
Thus the hysteresis type ON-OFF control and the con- 
tinuous self-adaptive control, respectively, are appropri- 
ace: 

From a philosophical point of view, it is interesting to 
note that the peculiarities of the attitude control prob- 
lem have led to a required control configuration which is 
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not optimum in the sense of satisfying any particular 
error criterion. The optimum configuration is generated 
as a result of a trade-off study considering many factors 
of which performance is only one. 
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Analysis and Design of Feedback Systems with Gain 
and Time Constant Variations™ 


KAN CHEN, ASSOCIATE MEMBER, IRE 


Summary—The design of a feedback control system containing 
an element with proportional variation of gain and time constant is a 
common problem encountered by control engineers in practice. The 
problem includes the stabilization of a system, which is open-loop un- 
stable when both the gain and the time constant of the element are 
negative. This paper presents a method for analyzing the transient 
response of systems containing the aforementioned element, and 
designing the systems to meet transient specifications. 


INTRODUCTION 


HIS paper is concerned with the analysis and de- 

sign of feedback control systems (shown in Fig. 1), 

which contain an element subject to proportional 
variation of gain and time constant. Thus, the element 
has a transfer function with the following form, 


K 


a 


———— —; 1 
= (1) 
—s-+e1 


a 


where K and 7 are the nominal values of the gain and 


the time constant, respectively. The parameter @ may 


_ 


vary with load or environmental conditions at a rate 
much lower than the system transients. The design of 
such a system is usually more difficult than that of a 
system containing fixed parameters. This is particularly 
so when a becomes negative (a <0), in which case the 
system is open-loop unstable. 
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Although the transfer function (1) appears to repre- 
sent only a limited class of elements, such elements are 
frequently encountered in practice. A few examples will 
be enumerated below. It will also become obvious that 
the method to be presented can easily be extended to 
study the effects of slow variations of several parameters 
in a system. 


Fig. 1—Feedback loop including element subject to gain and 
time-constant variations. 


PRACTICAL EXAMPLES 


A. Rotating Generator Under a Wide Temperature 
Range (a>0) 


In controlling the output voltage of a generator, the 
field current is varied by changing the applied voltage 
to the field. The voltage gain of the generator is there- 
fore inversely proportional to the field resistance. The 
same is true for the time constant of the field winding, 
since it is equal to the ratio of its inductance to its re- 
sistance. Consequently, the voltage gain and the time 
constant will vary in direct proportion as the field re- 
sistance varies with temperature. The frequency re- 
sponse function of the generator is hence described by 
(1), in which a>0 is proportional to the slowly varying 
field resistance. 


74 IRE TRANSACTIONS ON AUTOMATIC CONTROL 


B. Open-Loop Instability in Reactor Controlled AC 
Motor Drives 


In a reactor-controlled ac motor-drive system |1], the 
developed motor torque 7 is dependent upon the reactor 
control current J/,. The speed (7)-torque (rt) character- 
istics are shown as a family of curves in Fig. 2, each 
curve corresponding to a certain value of reactor control 
current. For a small range of operation, the dynamic 
characteristics of the linearized system are represented 
by the block diagram in Fig. 3. The transfer function be- 
tween motor speed and reactor control current is in the 
form of (1), with 

OT 
K= , 
Ol. 


i = J (inertia), 


and 


OT 


CS: 


on 


Obviously, the value of a is negative at the operating 
point P2, shown in Fig. 2. In other words, the open- 
loop system (J,=constant) is unstable, since the slight- 
est increase (or decrease) in speed would cause addi- 
tional acceleration (or deceleration). This is always the 
case when the system tries to regulate at low speed. 

Other examples which can be cited are control sys- 
tems using magnetic amplifiers within wide temperature 
ranges, voltage control of self-excited alternators under 
capacitive loads, and speed control of steam turbines 
within wide speed ranges. 


SPEED 


0 TORQUE T 


Fig. 2—Speed-torque characteristics of ac motor drives. 
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RELATIONSHIP BETWEEN OpEN-Loop BODE PLOT 
AND CLOSED-Loop TRANSIENT RESPONSE 


It has been found that the gain asymptotes of the 
open-loop Bode plot can be used to determine quickly 
the approximate locations of the closed-loop poles [2]. 
The rules for the approximate evaluation and the effect 
of the closed-loop poles on transient response are as 
follows: 


1) The open-loop poles which correspond to asymp- 
tote breaks below the — 15-db line are also approxi- 
mate closed-loop poles. These poles give small and 
rapidly decaying transient terms, which have 
negligible effect upon the main transient response. 

2) The open-loop zeros which correspond to asymp- 
tote breaks above the +15-db line are the approxi- 
mate closed-loop poles. These poles give small but 
slowly decaying transient terms, which have in- 
significant effect upon the main transient response, 
but may add a long tail to the system transient. 

3) The asymptote breaks inside the +15-db band de- 
termine the approximate location of the dominant 
closed-loop poles, which in turn determine the 
main system transient. 


These rules constitute the basis of the methods pre- 
sented in this paper. 


MeETHOD oF ANALYSIS 


Consider the feedback control system shown in Fig. 1. 
It is assumed that the only varying parameter in this 
system is a. 


A. Positive a 


If the variable parameter a remains positive, the 
above rules may be used without modification. The 
Bode gain asymptotes for the transfer function in (1) are 
shown in Fig. 4. Notice that as a varies, the asymptote 
with —20 db/decade slope is fixed in position. Only the 
horizontal asymptote moves with varying a. If a two- 
time constant controller is considered, 


ss Ao 
(Tis: IN Tes + 1) 


A(s) (2) 


—20 DB/DEC 


Fig. 3—Linearized block diagram of ac motor-drive 
speed-control systems, 


Fig. 4—Bode plot of the element with proportional 
variation of gain and time constant. 
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In this case, the Bode plot is like that shown in Erigveos 
If the gain (4)K/a) remains greater than +15-db and if 
the time constant (7/a) remains greater than 7) and T», 
the Bode plot inside the +15-db band will not be af- 
fected and, therefore, the main system transient, as well 
as the system stability, will be relatively unaffected by 
the variation of a. This is an important result. It indi- 
cates a way to make the system insensitive to the vary- 
ing parameter a. 

If the time constant 7/a is relatively small and its 
corresponding break on the Bode plot is below the —15- 
db line, as shown in Fig. 6, the variation of a@ will affect 
the Bode plot within the +15-db band. However, since 
the only break dependent on a is below the —15-db line 
and therefore corresponds to a negligible transient 
term, the parameter a affects the system performance 
just as much as the loop gain (4)K/a) does. In other 
words, the main system transient depends upon a 
mainly through its effect upon the gain alone. Thus, it 
is usually true that the smaller the value of a, the 
faster the system responds and the more the system 
tends to be unstable. As has been shown in a previous 
paper [2], the dominant closed-loop poles can be approxi- 
mately determined by considering the open-loop trans- 
fer function corresponding to the Bode plot inside the 
+15-db band. Referring to Fig. 6, this means that the 
open-loop pole at —1/7\ is substituted by an open- 
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Fig. 5—Bode plot for large T/a. 
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Fig. 6—Bode plot for small T/a. 
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loop pole at the origin, and the open-loop pole at =a) i 
is simply ignored. In other words, 


Ayk 
G(s) = ae : 3 
Mar RCL eel); ; ( ) 


Therefore, the approximate dominant closed-loop poles 
will vary with a as shown by the root locus in Fig. 7. 

When the asymptote break dependent on a is within 
the +15-db band, the main system transient depends 
upn @ through its effect on both the gain and the time 
constant 7/a. When this is the case, the method of 
“root contours” [3] may be used to determine the main 
system transient. For example, if the Bode plot is like 
that shown in Fig. 8, the open-loop transfer function is 
approximately [2 | 


G(s) = Sey a etn ) (4) 
(s+ 1) 
a 


where w, is the crossover frequency, the frequency at 
which the Bode asymptotes cross the 0-db line. The ex- 
pression in (4) is obtained by ignoring all the breaks 
outside the +15-db band. Thus, the corresponding ap- 
proximate closed-loop transfer function is 


G w 
~ 2 } (5) 
14+G Ts?+as+ a, 
ARROW SHOWS 
INCREASING 
( Ao Kk ) S-PLANE 
—x X5 
pele 
T2 
Fig. 7—Root locus of dominant closed-loop poles for the 
case of small 7’/a. 
+15 DB 
‘ w 


DECREASING a 


Fig. 8—Bode plot for medium T/a. 


76 IRE TRANSACTIONS ON AUTOMATIC CONTROL 


and the corresponding approximate dominant closed- 
loop poles are 
PrN) Oa on 


Ra AS : 6 
p a (6) 


The root contours (loci of sp for various values of a) are 
shown in Fig. 9. Again, decreasing a tends to make the 
system respond faster but become more unstable. 

Although the examples given above are for a second- 
order controller, it is clear that the method of analysis 
is good for systems of any order. 


B. Negative a 


When the value of a is negative, the open-loop sys- 
tem is unstable, and the rules given previously for the 
approximate evaluation of closed-loop poles from the 
Bode plot are no longer applicable. However, the same 
rules may be used if the following approximation is 
made: 


IE 

a K 
T bees 
—stl1 


I 


b-@+@-@* 


Ka I 
= sar Teas 1) for 


|= 
IES 


eile (7) 


Si 


Now, for negative values of a, every term on the right- 
hand side of (7) is positive and the rules given previously 
for the Bode plot analysis will be valid. The approxima- 
tion is good, provided that the frequency under consid- 
eration is high as compared to |a| /T, so that the higher 
order terms of a/T7’s are negligible. 

Another way to see the validity of approximation (7) 
is to compare the frequency response characteristics of 
the exact expression with those of the approximate ex- 
pression. With s replaced by jw, the exact expression on 
the left-hand side of (7) has the following amplitude and 
phase angle: 


K 
Amplitude ee 
Va? + (Tw)? 
K 1 
tae TiS (8) 
ate 
Wis 
Tw 
Phase = — arctan — - (9) 
a 


The approximate expression on the right-hand side of 
(7) has the following amplitude and phase angle: 
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Fig. 9—Root contours of dominant closed-loop poles for the 
case of medium 77/a. 
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Fig. 10—A fifth order system containing an element with proportional 
variation of gain and time constant. 
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Fig. 11—Bode plot analysis of the fifth order system in Fig. 10. 


; Ka (Tw)? 
Amplitude = \/ +1; (10) 
(Tw)? a 
Tw 
Phase = — arctan—- (11) 
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It is seen that the exact and approximate expressions 
have identical phase angles at all frequencies. Although 
their amplitudes are different at low frequencies, when 
Tw/a>1, both amplitudes approach (K/Tw) and are 
therefore approximately equal to each other. 

It is recalled that the main system transient is closely 
correlated to the Bode plot within the +15-db band or 
near the crossover frequency w,. Thus, if the crossover 
frequency w, of the system is much higher than | a| page 
or the break due to | | /T is above the +15-db line, 
then the approximation (7) is good for estimating the 
major system transient performance. Furthermore, if 
|a| /T is kept small enough so that its corresponding 
break on the Bode plot (using the exact expression for 
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auuaae! H i TH at EEE 
t tt +H H H H PEE i He aeee souaa seag a ae 
a: Ht t a 4 ey HE HH EEE i aoe a b | HH 
: ee d i SEE EERE ioatooteasticd 
i oot Ht : Fig. 13—Approximate transient response of the fifth-order 
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: se z Eee EEE The analysis given in the last section sheds light upon 
: z eepeeeeeeeeeee i 4 the principle of design for feedback control systems con- 
a te taining varying gain and time constants. In order that 
Hh HH ae the system transient response will be essentially unaf- 
= 1 fected by the variation of the parameter a, the designer 
aasatassoeseeoeeeeeesets i should exercise his freedom by choosing the controller 
7 transfer function A(s) such that the break due to 7’/a 
: cae in the Bode plot lies above the +15-db line. 
i Example 1. (Refer to Fig. 1). 
= z Given: 
= 1 
. : ; : F(s) = ) 
Fig. 12—Exact transient responses of the fifth- order system in Fig. 10 0.5 
ast 
a 
positive a@ and the approximate expression for negative Rove 
a) is always above the +15-db line, then the major sys- 
tem transient will not be affected very much by the —2<a<4+4. 
variation of a. The following example illustrates this ; 
Specified : 


point. 

Fig. 10 shows a fifth-order system with the parameter 
a to vary from positive to negative values. In this case, 
T is equal to unity. The Bode plot of the system with 
a=O0 is shown by solid lines in Fig. 11. It is seen that the 
Bode plot crosses the +15-db line at w=0.44 rad/second. 
Therefore, if a is less than 0.44, the Bode plot within the 


_+415-db band will not be affected by a (see the dotted 


lines in Fig. 11), and the major system transient re- 
sponse is essentially the same. This is evidenced by the 
system responses to a step input shown in Fig. 12. The 


_ three transients in this figure were obtained on an analog 
_ computer and correspond to a= +0.44, 0 and —0.44, 


respectively. Notice that the overshoot and rise time in 
all three cases are almost identical. Fig. 13 shows the 
analog computer results of the system response for 


a= -—0.44, when the portion of the system involving a 


is replaced by the approximation given by (7). The com- 


- parison of this transient with the third one in Fig, 12 
_ shows how good the approximation is. a 


| E/R| (at zero frequency) <0.1. 
Bandwidth: between 50 and 150 radians/second. 
Damping ratio of dominant closed-loop poles > 0.5. 


To find: A(s). 

The three specifications given above are related, re- 
spectively, to the desired accuracy, response time, and 
relative stability (or overshoot of response to step input) 
of the closed-loop system. Since the open-loop Bode plot 
within the +15-db band determines the bandwidth and 
the damping ratio of the dominant poles, the designer 
should shape this part of the open-loop Bode plot to 
meet the closed-loop system specifications. Thus, in 
Fig. 14, we obtain the asymptotes (b) and (c) within the 
+15-db band. Notice that the bandwidth of the closed- 
loop system will be approximately equal to the crossover 
frequency (frequency at which the Bode asymptotes 
cross the 0-db line) at 100 radians/second. The break at 
100 radians/second is chosen so that the transfer func- 
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Fig. 14—Design on Bode plot for example 1. 


tion inside the +15-db band is approximately given by 


100 
G(s) = ——————_- (2) 
§ 
s{— + 1) 
100 
and 
G 100 
~ (13) 
1+G Ge 
—+ts-+ 100 
100 


Thus, the damping ratio of the approximate dominant 
closed-loop poles is 0.5. 

If the gain of the controller is Ao, the ratio of error E 
to reference FR is given by 


Ja, 1 a 


R fe ge 
a 


(14) 


The worst case corresponds to a=4. To meet the ac- 
curacy specification of | E/R| <0:1; 


(1 — 0.1)4 
Gal eee 


Ay = 36, (15) 


or a loop gain of 9. This fixes the low-frequency asymp- 
tote (a) in Fig. 14 for the case of a= 4. Using the asymp- 
totes (a), (b) and (c) in Fig. 14, we have the following 
transfer function for the controller: 


a : —- 1) 
8 
ee) cau) 
itil 100 
The zero at s= —8 is used to cancel the pole of F(s) at 
the same location for the case of a=4. 
Now the effect of varying a is studied. Using the 
method given in the last section, the asymptotes corre- 


sponding to a=0 and a= —2 are obtained as indicated 
in Fig. 14. It is noticed that the Bode plot within the 


A(s) = (16) 


February 


+15-db band is unaffected by a, and therefore the given 
specifications are met regardless of the variation of a. 

Example 1 is a relatively easy design problem since, 
fortunately, the break due to 7T/a can easily be re- 
stricted to above the +15-db line. It is clear that this 
would not be the situation if the specified bandwidth 
for the closed-loop system should be considerably nar- 
rower, for reasons of noise rejection and less requirement 
of maximum available forcing in the power amplifiers. 
In this case, the Bode plot within the +15-db band will 
be affected by a. A minor feedback loop will then be de- 
sirable to limit the variation of the Bode plot within the 
+15-db band. 


Examble 2 


The design problem is the same as in Example 1 ex- 
cept that the bandwidth is expected to be between 3 and 
9 radians/second. 

A quick try of the approach used in Example 1 shows 
that the same approach will not work in this example, 
since the break frequency due to 7/a (equal to 8 ra- 
dians/second for a= +4) is in the order of the specified 
bandwidth. Thus, we try to use the Bode plot configura- 
tion shown in Fig. 6. In this figure, it is noticed that the 
bandwidth of the closed-loop system changes in direct 
proportion to a. Besides, the approximation used in (7) 
cannot be applied for the frequency range near the 
bandwidth. One way to get around this problem is to 
use minor loop feedback around the given controlled 
element, as in Fig. 15. Now the minor closed-loop trans- 


Fig. 15—Minor loop feedback for example 2. 


fer function is 
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a+B Be 
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where a,=a+B is the equivalent a of the minor loop. 
Recall in the analysis of Fig. 6 that as a increases, the 
bandwidth will decrease proportionally. Thus, to limit 
the bandwidth variation to within 3 to 9 radians/second 
as specified, we shall choose B such that a, varies by only 
a factor of 3, for —2<a<4. That is, 


4+ B 


27 Aes ee 


——— 
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Hence, 
Ba 5, 


Now we can design the controller transfer function 
A (s). We shall first consider the case of a= —2 or GS. 
Since this is expected to correspond to minimum relative 
stability and maximum bandwidth, we obtain the 
asymptotes (b) and (c) in Fig. 16. These asymptotes 
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Fig. 16—Design on Bode plot for example 2. 


give a bandwidth of 9 radians/second and damping 
ratio of dominant closed-loop poles equal to 0.5. An- 
ticipating that the loop gain will reduce by a factor of 3 
when a, takes the opposite extreme value, the low-fre- 
quency asymptote (a) in Fig. 16 is chosen to give a loop 
gain of 27. Using the asymptotes (a), (b), and (c) in 
Fig. 16, we obtain the following controller transfer 


function: 
si( : _ 1) 
6 


os G+) 


A(s) = (19) 
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/ 


As shown in Fig. 16, when a,=9 (or a=4), the band- 
width will decrease to 3 radians/second, the loop gain to 
9, and the system will be relatively more stable (higher 
damping ratio). Therefore, the system meets all specifi- 
cations, regardless of the variation of a. 


CONCLUSION 


A method of analyzing and designing feedback con- 
trol systems containing varying gain and time constant 
has been presented. The method is based mainly on a 
relationship which has previously been established be- 
tween transient response and Bode plot. The method 
has been shown to be applicable also to open-loop un- 
stable systems. 

Although the variations of gain and time constant are 
assumed to be directly proportional in this paper, as is 
found in many practical cases, the author feels that the 
general approach given in this paper can be readily ex- 
tended to the analysis and design of systems containing 
other types of parameter variations. 
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Evaluation of Transient Response Coefficients 


D. S. BILLINGSLEY} anp M. G. REKOFF, JR.{, MEMBER, IRE 


Summary—A method is presented for evaluating the transient 
response coefficients of response functions having poles of any mul- 
tiplicity. The calculations are effected by use of a recursion-type 
formula with data obtained from distance and angle measurements 
on the root-locus plot of the system being analyzed. 


INTRODUCTION 
( Sic of the great advantages in the use of the root- 


locus method is the ability to determine graphi- 

cally the coefficients for the transient response of 
the closed-loop system to various forms of excitations 
such as unit impulse, unit step and the unit doublet. The 
procedure in the absence of multiple roots is straight- 
forward and is described in several [1 |-[3] publications. 
If, however, one wishes to investigate systems with 
higher-order excitations as unit ramp or unit accelera- 
tion, or, if one wishes to examine functions having roots 
of multiplicity greater than one, then the conventional 
techniques must be extended. Murphy [1] has illus- 
trated a procedure for obtaining the transient response 
coefficients via graphical measurements for response 
functions having poles of multiplicity two. It is the 
authors’ purpose to extend Murphy’s procedure so that 
response functions of any multiplicity m can be deter- 
mined thereby. The method to be presented does not re- 
move the inherent difficulty of the graphical evaluation, 
but presents relations and outlines a logical sequence 
of steps to minimize the labor required. Since large mul- 
tiplicities are not expected in practical analysis, the 
authors have included a table for determining coeffi- 
cients for multiplicities of 2 through 6. It is possible to 
develop a recursion-type expression from which one 
may determine coefficients of any multiplicity m; how- 
ever, the expression is too cumbersome to be of practical 
value, and for multiplicities of 5 or larger, it is more 
expeditious to continue the differentiation described 
below. 


COEFFICIENTS OBTAINED BY PARTIAL 
FRACTION EXPANSION 


Let the expression 


k II (s — 2) 


a 
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represent the output of the system under investigation 
when excited with an appropriate input. Suppose there 
exist one or more poles of multiplicity greater than 1 
and consider one such pole py» of multiplicity m; then 
this expression can be rewritten as 


Rk I] (s —— Zi) 
(5. — po) [1 (s — pa) 


jAw 


aki 


Expansion in partial fractions produces 
ae Ne 


cs) = DU 


n=1 (s = pale 


+ [remaining terms in partial fraction expansion], 


where the X,, are the coefficients associated with the pole 
of multiplicity mand are determined by proceeding with 
the partial fraction expansion obtaining 


(oo pu) c= a ata 


n=1 


+ (s — pw)” [remaining terms]. 


Using the conventional method of evaluating the A, one 
proceeds as follows: 


k I Ges =i Z:) 
a a [(s aoe pw)™¢(s) | ia TT Ge = 0) 


To evaluate \m—1 
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sp, 


To evaluate Am_2, 
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= Di (m — n)(m — n = 1)(5 — pw)", 
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and 


1 @ 
Am—2 = lim E — \(s — aere(s)} |, 


op, 2! ds? 


from which one can obtain the general expression 


Baty teas 
Am—q = lim | — 

Spy q! ds? 
Observe that in evaluating each of the Am—q One must 


take the gth-order derivative of (=P) c(s)) with te- 
spect to s. Since 


{ (s = oo)ne(s)} | 1Sqsm-i. 
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it appears that some closed form for the derivative of 
ratios of products would be useful. 


EXPRESSION FOR THE DERIVATIVE OF 
RATIO OF PRODUCTS 


It has been shown [4] that 


Gia) = Gt = == 4): 
Il VE Il Ut Ur 

Applying this expression to the problem at hand 
where s is the independent variable, let 


Up = (s—2,) and u, = (s — pi), 


from which it follows that 


duy 
and —— = 1. 
ds ds 


One obtains 
aid etree 
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For convenience in discussion, let 


Pas eS and Q:= [Do u,-?— 


II ». 
The above expression then becomes 


= PQ. 


yh vi! 


- To perform successive differentiations, an expression for 
Qy’ is required and it can easily be verified that 


QO! = — 1Q0i41. 
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Using the above relations, the successive derivatives 
can be determined as follows: 


(P)/' = PO, 

C2 ieee (Oi — >) 

= P20; 3007 1-. 0x) 

(P)Y = P(Os4 — 604 — 80301 + 302? — 60,202) 
(2 P (240 300,0,-=200,0;-- 200,70 


ate 150102" — 100102 + O1°) 
(Pl = P(Qs5 — 12006 + 1440.0; + 900201 + 400? 
— 900,204 — 120010203 — 150.3 
+ 4001303 + 4501202? — 150:40.). 


EVALUATION OF COEFFICIENTS 


Assuming that complex poles and zeros occur in con- 
jugate pairs, one obtains 


II (Pw 7, 2:) 
ie (pw = p;) ; 


wx} 


An = him bs 


sp, 
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where, in general, A,, is a complex number whose magni- 
tude and angle can be determined directly from meas- 
urements on the root-locus diagram. The magnitude 


IT |e — # 
Tl teed 


iAw 


| n| = 


is the product and quotient of “distances” between py, 
the root of multiplicity m, and the remaining poles and 
zeros of the loop transmission. The 


arg (Am) = ye arg (pw — 2) — 2) arg (ew — pj). 


jw 


If p, is real or zero, the argument of A, is zero and X» is 
a real number, resulting in the time function 


m 
cat {leew Lis 


m! 


If p» is a complex number, then the argument of A,» is 
not zero and A» is complex. Since the complex poles and 
zeros occur in conjugate pairs, the complex pairs can be 
combined and the time function 


1 
2 | Ned ar ™—1¢-ew! cos [wWyt + arg (Am) | 
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obtained, where 


Pw = — Ow = eats 


82 IRE TRANSACTIONS ON AUTOMATIC CONTROL 


Murphy [1] demonstrated the procedure to obtain 


Il 


a Pw — ay 1 il 
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where m= 2 for real py. 

\m—1 18 Of course, in general, a complex number, and 
can describe a transient response component of complex 
poles via the latter-time expression above. This expres- 
sion for \»1 illustrates the difficulty of evaluation of 
transient response coefficients systems possessing roots 
of multiplicities greater than one. In the authors’ nota- 
tion then, 


if 
NG = lim FF P| 
eae 


since by previous notation, 


’ 
s=p 


iat 1 
= lim | PQ; = 77 AmO1 


sp, 


lim kP = An. 


SP, 


Let @, denote Q; 
becomes 


s=p,; then the previous expression 


Since 


1 1 
Oy = > De |, 
| ; (pw = Bi)? jew (Pw HY Pa): 


1 
\m—3 = 3) Am | @13 + 2@; — 3@, @>| 
1 
= qi alent + 3@,” — 6@; + 8@;@, — 6@@| 


1 
\m—5 = I Am|24 @s — 30@1@, — 20@.@; + 20@,’@, 


+ 15@,@.? — 10@3@, + @,5| 


1 
Ai Am[ @i5 — 120@, + 144@,@, + 90@,@, 


+ 40 @,? — 90 @,"@, — 1208, @,@, — 15.@, 


+ 40@,%@, + 45@,2@,? — 15@,'@]. 
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Another approach by which one may, without a 
knowledge of calculus, determine coefficients of high- 
order poles has been presented by Hazony and Riley 
[5] in a paper published subsequent to the preparation 
of this article. 


CONCLUSION 


Application of the preceding procedure to response 
functions having poles of high multiplicity permits cal- 
culation of the transient response coefficients associated 
with such poles with appreciably less effort than is re- 
quired by other techniques. 


APPENDIX 
Example: 


Given the following pole-zero configuration for some 
system excited with the unit step input shown in Fig. 1, 


S-PLANE 


316/108.4° 


Fig. 1—Evaluation of transient response coefficients. 


one calculates for the pole of multiplicity 4, 


| 1 1 1 4 | 
Q,;= — ane, 

' 13/908. 5/36.8° 3.16/108.4  6/90° 
=0.753/94.6° 


te 1 1 1 4 
~~ L9/180°  25/73.6° 9.98/216.8°  36/180° 
0.072 elias? 


- | 1 1 1 4 | 
Re es ey a 
27/2702 125/110. 4° 431. 6/325 2°) 216/270 
=0.0245/161 0s, 
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and obtains 
#3/90° 
oe (5/36. 8°) (6/450) (3. 16/108. 4°) 
0.00014642/—55.2° 


1 1 
Ns = 7 Ms@1 = + (0..00014642/—55.2°)(0.753/94.6°) 
= 0.0001103%/39.4° 


1 
hy = 5 Males? — @2] = 3(0.0001464k/—55. 2°) 


l| 


().0000461%/130.9° 


1 
Ay 3, l2es a] 3@1@2 - @1°| 


I 


1 
3 (0-0001464%/— 55. 2°) [2(0.0245/161 . 0°) 


— 3(0.072/—17.4°)(0.753/94.6°) + (0.753/94.6°)>| 


II 
=) 
=) 
= 
=) 
(an) 
st 
Ww 
on 
ee) 
a> 

Pe 

r 
pr 
nS 
as 
\O 
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which yields the following portion of the time response 
due to the poles of multiplicity 4 at —1+]3: 


* + 0.0000122k¢%e-* cos (34 — Soh) 
+ 0.00003 68ki?e—! cos (3¢ + 39.4°) 
+ 0.0000461kte~* cos (3¢ + 130.9°) 
+ 0.00002716ke-* cos (34 — 144.9°) 
Se 
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CORRECTION 


Masanao Aoki, author of “On Optimal and Subopti- 
mal Policies in the Choice of Control Forces for Final 
Value Systems,” which appeared on pages 171-178 of 
the August, 1960, issue of these TRANSACTIONS, has re- 
quested that the following Fig. 2 be substituted for the 
one which appeared on page 177 of the above. 


THE STATE VARIABLE OF THE SYSTEM, X,, 


THE NUMBER OF REMAINING 
CONTROL STAGES,4 


|xpl $0 5 DF I/4 


d=-(2p-i)e/a 


9*-1/56 FOR 9*7/8, ¢*I/i6, AND p= 5/8 


X_rd 
Xp *-0.125 4 


n*0 Ky #0125 


X, 10.25 


~ — —(x,n) WHERE m IS THE OPTIMAL CONTROL FORCE 


(x,n) WHERE =m 1S THE OPTIMAL CONTROL FORCE 


m*9/\28 


Fig. 2. 
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Correspondence 


Discussion of “On Adaptive 
Control Systems” 


The system described by Braun! is simi- 
lar in philosophy to the system described 
by Mishkin and Haddad.? In the latter, an 
attempt was made to drive the error and its 
derivatives approximately to zero by the end 
of each control interval. In the system of 
Braun, it appears the error and its deriva- 
tives are to go instantly to zero at the start 
of each control interval and to remain ap- 
proximately zero for the duration of the 
control interval. This is physically impos- 
sible in any real system. That is, with finite 
power we cannot achieve instantaneous 
change in the output. 

Taking the Laplace transform of (26) 
yields the transfer function from error at the 
sampling instants to the additional actuator 
command, 


E(s) = AM(s)G(s), (1) 
or 
AM(s) __ 1 
iy © .GS) Ata) 


Eq. (1a) represents a physically unrealizable 
condition, for an arbitrary command signal. 
However, if we concede the approximate 
generation of impulses in AM, and G(s) is 
of order 1, as in Braun’s examples, (1) can 
be approximately realized. In this case, (29) 
is obtained by long division of G into E. If 
G(s) is of order g>2, Braun seems to sug- 
gest in (30) that we ignore the error and its 
first g—2 derivatives, apparently for the 
sake of compatible equations. This would 
result in poor control action, in which no 
control action was made on the error itself. 
Our driver might go parallel to the road, but 
not on it. A better alternative would be to 
include some sort of dynamics in (1) to 
achieve realizability, but necessarily aban- 
doning the attempt to have immediate cor- 
respondence between input and output. 

Both the systems of Mishkin and Haddad 
and of Braun are linear. If the time variation 
in the plant parameters is slow enough to 
be negligible, the stability analysis is rela- 
tively simple, using the techniques for the 
analysis*of sampled-data systems.? Such an 
analysis has been made for the system of 
Mishkin and Haddad,‘ and the analysis of 
Braun’s system proceeds in an identical 
fashion. A brief outline is given below. 

The transfer function from error to 


* Received by the PGAC, April 8, 1960. 

1L. Braun, Jr., “On adaptive control systems,” 
IRE Trans. on AUTOMATIC CONTROL, vol. AC-4, pp. 
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and command problems in adaptive systems,” 1959 
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8J. R. Ragazzini and G. F. Franklin, “Sampled 
Data Control Systems,” McGraw-Hill Book Co., Inc., 
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4R. M. du Plessis, “Application of the Z-Trans- 
formation to the Analysis of an Adaptive Control 
System,” Internal Rept. Autonetics Div., North 
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actuator command will be taken as 


E(s) 1 


= , 2 
AM(s) — s*"G(s) 2) 


where q is the order of the plant. More pre- 
cisely, (2) is the transfer function from the 
error just prior to the sampling instants, 
expressed as a MacLaurin series, to the 
additional actuator command applied at the 
sampling instants, expressed asa MacLaurin 
series. Some other physically realiazble 
transfer function could have been used in- 
stead of (2), perhaps with better control ac- 
tion, but in any case the analysis is the 
same. If we truncate to NV terms, there re- 
sults the block diagram of Fig. 1, with the 
various matrix quantities defined in Fig. 2. 


Actuator Command 

(Maclaurin Coefficients) 

Cd Output 
-! AM 


ee an 


Integrators for forming 


Desired Output 


N-Channel Controller 


Maclaurin Series from 
Coefficients, Plant, 
Delay, and Derivative 
Sensors 


Fig. 1—Block diagram of system, 
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and 
C = H(AM). (4) 
Combining (3) and (4) gives 
(1 + HG 4)C = HG Cy. (5) 
For stability, then, 
Det (1+ HG") #0 for |z| >1. © 


Thus, the stability analysis solicited by 
Braun in the Conclusions is readily supplied, 
for the case of negligible parameter vari- 
ation. A condition very much like (6) was 
determined‘ for the system of Mishkin and 
Haddad, and various examples worked. As 
might be expected in dealing with a linear 
feedback controller, the system was stable 
in some cases and unstable in others. The 
same would be true here. 

If this idea is to be pursued further, it 
must first be modified for realizability. It 
would then be interesting to see it applied to 
a control problem worthy of such complex 
control means, such as a statically unstable 
airframe with pronounced flexibility prob- 
lems. Solutions of (5) for C(z) and testing 


Ca(Z 
a(Z) he M_4(2) 
as Ca(Z) | Desired Output AM)(Z) MacLaurin Coefficients 
(f S - = a 5) 
‘ (Sampled) of Actuator Command 
Nei AMy_2(Z 
Ca (Z) vies )| 
C(Z) Gq 0 0 ---0 
5 G 
ee C@) Output Gu as s i : 
or ” (Sampled) San iy ne wr 
Nei, : , 
Cc (Z) GqiN-1 Gq 
; ' _ oo GK 
with Gx given by G(s) = : SK 
Isls) Ho Hy . Hy_2 
Hes Hey 5 
Hes, (Ha Hay pao e = de 
a ea iene : ae SI-K < 
i ‘ a>>T 
Hn 185i 


Fig. 2—Definition of quantities in Fig. 1. 


The slight delay in the transfer function 1 
permits us to neglect instrument dynamics 
and yet avoid difficulties with discontinuous 
derivatives at sampling instants. 

From the block diagram, 


AM =G-(C; — ©) (3) 


for stability by the condition (6) would not 

be prohibitively difficult using a high-speed 
computer, 

R. M. pu PLEssIs 

Autonetics Div. 

North American Aviation, Inc. 

Downey, Calif. 
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Author's Comment® 


Mr. du Plessis has made a number of 
interesting and constructive comments re- 
garding the subject paper by this author. 
He points out the undesirable aspects of 
impulse drives—correctly, of course. He 
further indicates that, in (30) of the subject 
paper, the value of the error and its first 
g—2 derivatives are ignored, “for the sake of 
compatible equations.” This latter point is 
not quite correct. If G(s) is of order g, and 
AM(s) is a linear combination of an impulse 
and the first m integrals of an impulse, then 
it may be shown, using the initial-value 
theorem, that e(0+-) and the first q—2 de- 
rivatives of e(¢)—all evaluated at :=0-+— 
are identically zero. If AM(s) contains 
higher-order impulses, fewer than q—2 de- 
rivatives of e(t) are zero. 

Mr. du Plessis points out the similarity of 
the philosophy of the author’s approach to 
that taken by Mishkin and Haddad. This 
author has worked in the same research 
group with Mishkin and Haddad for several 
years. The philosophy in the subject paper 
and in the Mishkin-Haddad paper is an out- 
growth of a mutual effort in this area. The 
Mishkin-Haddad system is clearly superior 
to the one proposed by this author—in fact, 
the Mishkin-Haddad system is a result of 
efforts to overcome the practical difficulties 
in the earlier system. 

In the opinion of the author, the contri- 
bution (if there is any) of the paper is in the 
philosophy developed; the particular appli- 
cation having been introduced only for 
illustrative purposes. 

Mr. du Plessis has made an interesting ap- 
plication of sampled-data theory in the sta- 
bility analysis he suggests. 

Lupwic BRAuwN, JR. 
Polytechnic Inst. of Brooklyn 
Brooklyn, N. Y. 


5 Received by PGAC, July 8, 1960. 


Two Digital Computer Programs for 
Use with Multirate Sampled-Data 
System Analysis* 


Two digital computer programs were 
written last year at North American Avia- 
tion, Inc., in connection with the analysis of 
multirate sampled-data systems, which 
might be of interest to people engaged in 
similar analysis work. The systems under 
consideration were more or less like the 
block diagram of Fig. 1. 
These programs were entitled 1) Multi- 
rate Z-Transform Program and 2) Multi- 
rate Z-Frequency-Response Program. They 
were programmed in the FORTRAN sys- 
tem on the IBM 709 by J. C. Long of the 
Missile Division of North American Avia- 
tion, Inc. 


__ * Received by the PGAC, July 21, 1960. 
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MULTIRATE Z-TRANSFORM PROGRAM 


The purpose of this program is to trans- 
form expressions in z,=e*7n, representing a 
time function sampled “fast” at T/n, into 
an expression in s=e*", representing the 
same time function sampled “slow” at T. 
In order to make this transformation, a 
table suitable for look-up operations in a 
computer was derived. This table was de- 
rived by the formula given by Ragazzini 
and Franklin,} 


ZIG )] if 1 { G(Zn) dZn, 
Zn 2ajJp mm (1 — an"27) 
G(En 
poles of x) : (1) 
Zn 


Some fairly simple transform pairs resulted, 
as shown in Table I. 

The method of computation is to break 
up the expression to be transformed into 


Fig. 1. 
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partial fractions of the type in Table I, to 
transform according to Table I, and to re- 
combine, and factor the result. This process 
is illustrated in Fig, 2. 


MULTIRATE Z-FREQUENCY RESPONSE 
PROGRAM 


The purpose of this program is to take 
expressions in z,=e*"/", representing a time 
function “fast” sampled at T’/n, and to ob- 
tain directly the frequency response, or 
mapping of the unit circle, of Z[G(z,)], 
“slow” sampled at T. The basis of this pro- 
gram is a formula appearing in Jury 22 


INPUT: G (z) 


PARTIAL FRACTION 
EXPANSION 
TABLE A 


RECOMBINATION OF 
TRANSFORMED TERMS 
AND FACTORING 


ouTpuT: [c (2)| 
Fig. 2. 


TABLE I 
MULTIRATE Z-TRANSFORM PAIRS FOR SAMPLED DATA System ANALYSIS 


G(én) Z[GGn)] 
kG(zn) kZ[G(en)] 
Zn ?, pb ~kn 0 
Zn ?, bp = kn oan 
1 (fo 
(Zn — a) goa? 
1 a?r-2 1 (ny — 1)qn-2z 
(Zn — a)? (= (a")2 
1 208-8 + (nm + 4)(m — 1)a2"-%s + (m —1)(n — 2)a”-3g2 
Gn — a) 2i(2 — a®)8 
tthe A Pte [6a4"-4 4 (mn —1)(n? + 7n + 18)a3"~42 
(an — a)A 3!(2 — a”)4 
+ (m — 1)(4m2 + 4a — 18)a?"—4y" 
+ (n —1)(n — 2)(n — 3)a™-4z°] 
1 b(a? + b2)"™-1 + (a2 + 52)(™-/2 sin [(n — 1)0]z 


Zn? + 2azn + a? + b2 


Zn 


Zn” + 2azn + a2 + b? 


F (Zn”)G(Zn) 


b[z2 — 2(a2 + payne cos (n0)z + (a2 + b2)”] 


6= tan“! — 
a 


(a2 + 52)(™/2 sin (nO)z 


blz? — 2(a2 + b2)(™/2 cos (nd)z + (a2 + b2)”] 


b 
—a 


6= tan 


F(z)Z[G(zn)] 


(factors of the form F(z,”) can be excluded, for con- 
venience, from data input to computer) 


1J. R. Ragazzini and G. F. Franklin, “Sampled 
Da Coe Systems,” McGraw-Hill Book Co., Inc., 
New York, N. Y., p. 227; 1958. 


2E. I. Jury, “Sampled Data Control Systems,” 
John Wylie and Sons, Inc., New York, N. Y., p. 75; 
1958. 
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Z|G(2n) | = Ee 2 G(zner?mhln). (2) 
nN k=1 
The method of calculation is illustrated 
in Fig. 3. The input to the program is an 
expression G(z,) and the desired frequency 
points to be computed. These frequencies 
range from 


because higher frequencies lie on the same 
curve, or its conjugate. 


INPUTS: 
DESIRED FREQUENCY POINT 
G(x) 

n 


kel 

27k 
jwT n 
e e 


EVALUATE G(z_) FORz = 
n n 


AS (ak + jbk) 


ADD ak + jbk TO PREVIOUS SUM: 
D (ak + jbk) 
5 


DIVIDE BY n 


OUTPUT: 
FREQUENCY RESPONSE 


OF Zz [s+] 


INCREMENT 
kBYl 


Fig. 3. 


PROGRAM 1} 
Z - transform 
based on formula (1) 


ORDINARY 
SINGLE RATE 

Z FREQUENCY 
RESPONSE 


GAIN-PHASE 


Zee 


ROOT LOCUS, ETC 


PROGRAM 2 
Z - frequency 

response based 
on formula (2) 


Fig. 4. 


In actual practice, the second program 
has proved more convenient to use, because 
the output is already in a form for any de- 
sired frequency-domain stability plot, where- 
as the output of the first requires further 
analysis to determine stability (root locus). 
The relationship between these two pro- 
grams is shown in Fig. 4. 

R. M. pu PLEssis 

Autonetics 

North American Aviation, Inc. 
Downey, Calif. 


Short-Time Stability* 


The concept of stability plays a domi- 
nant role in control systems. However, the 
classical definitions—for example, “A linear 
varying-parameter system is defined to be 
stable if and only if every bounded input 
produces a bounded output”—suffer from 
some important shortcomings. One of them 
is that knowing that an output will be 
bounded is generally not sufficient. The 

* Received by the PGAC, August 5, 1960. 

1L, A. Zadeh, “On stability of linear varying- 


parameter systems,” J. Appl, Phys., vol. 22, pp. 402- 
405; April, 1951. 


exact value of the bound must also be 
known. In addition, the time interval of 
interest is often only of finite length. A case 
in point is that of a missile whose operation 
lasts only a finite time and whose variables 
must be restrained to certain critical values 
in this time interval. To overcome some of 
these difficulties, the following definition is 
proposed: 

Definition—A linear system with input 
x(t) and output 4(¢) is said to be short-time 
stable in the interval 0<t<T with respect to 
eand C if |x(t)|<e implies | y(¢)| <C in the 
interval0<t<T. 

A similar definition for unperturbed (no 
forcing function) systems is given by 
Chzhan-sy-in.? To illustrate this concept of 
stability, a theorem and some examples 
follow. 

Theorem—The necessary and sufficient 
condition for a linear time invariant system 
with impulsive response w(t) to be short- 
time stable over 0<t<T with respect to « 
and Cis 


f "| w(t [at < Cle (1) 


The sufficiency follows from the set of in- 
equalities, 


| y(2) | < fw) | a(t — 2’) | de” 


t 
<e f | w(")| a’ <C (2) 
0 
and 
t ; ve 
{ | w(t’) | dt’ < ar | w(t’) | ain, (B3) 
0 0 
To prove necessity requires that, when 
T 
if | w(#)| dt > C/e, 
0 
an input with |x(t)|<e can be found that 


causes an output |3(¢)| >C for some ¢ in 
0<t<T. The required input is 


a(T—t)=+e for w(t’) >0, 
s(T—t)=—e for wt’) <0, (4) 
for then, 


i 
y(T) f w(t!)x(T — t")at! 


; ip “lw [a >6. ~ 6) 
0 


For an example, consider w(t)=Ke*, 
which is unstable in the classic sense re- 
gardless of the value of K, excluding, of 
course, K =0. However, it will be short-time 
stable if K satisfies the inequality, 


T 
| | f edt < C/e. (6) 
0 
The required value of K is easily seen to be, 
C 
K ee: 
| | ~ e(e? — 1) (7) 


Note that the same system may be con- 
sidered stable or unstable depending on the 


2 Chzhan-sy-in, “Stability of motion during a 
finite time interval,” J. Appl. Math. and Mechanics, 
vol. 23, pp. 333-344; 1959. 
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particular choice of T, C, and e. Consider 
next w(t)=e-t—e~'. This system is classi- 
cally stable. However it can become short 
time unstable if T is too large since, 


ie | w(t) | dt = 3(e 7 — 1)? >C/e, (8) 


for T sufficiently large and, say, C/eX¢. 

It is hoped that this short note will 
stimulate interest in this concept of sta- 
bility and be of some use to control system 
engineers. 
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Sampling Schemes in Sampled- 
Data Control Systems*{ 


INTRODUCTION 


In the early development of the sampled- 
data field, it was assumed that the sampling 
pattern is periodic with fixed period 7, that 
the pulse width is of negligible duration, 
and that these short pulses are represented 
by impulses. Based on this representation, 
several analysis methods were developed, 
among them the z-transform method[1]-[3], 
the difference equation [4]-[6], and the state- 
variable approach [6], [7]. Following recent 
extension and research in this field, these pre- 
liminary assumptions have been relaxed to 
a large extent, so that wider application and 
more general methods of analysis could be 
developed. In the discussion of the first 
category on the fixed sampling pattern, it 
can be easily observed that the z-transform 
method with its various extensions is appli- 
cable to deal with all the indicated cases. 

For the second category, which includes 
varying sampling times and varying pulse 
width duration, the z-transform method is 
applied only in approximation cases, but the 
difference equation approach has more 
promise. Similarly, the latter is applicable 
to random sampling. It is assumed that in 
the first category the system operation is — 
linear, with time-invariant and time-varying — 
parameters. In the second category, the sys- 
tem operation is essentially nonlinear; and — 
in the third category, the system description 
is linear with randomly varying parameters. — 


SAMPLING SCHEMES 


To illustrate clearly the distinction be-_ 
tween the various operating conditions of — 
the sampled-data systems, the sampling 
schemes are divided and discussed in the fol- 
lowing three categories: 


* Received by the PGAC, October 17, 1960. 

} Based on a lecture delivered on April 29, 1960, 
at the University-Industry Colloquium, University of 
California, Berkeley. f 
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1) Fixed sampling pattern: In this part, 
only the fixed or predetermined pattern is 
included which characterizes the operation 
of the sampler (or the flow of information). 
This is divided into the following: 


a) Periodic sampling with fixed period 
T and negligible pulse width duration 
(impulses), shown in Fig. 1. 
Staggered sampling with same period, 
shown in Fig. 2. 

c) Multi-rate sampling (Fig. 3). 

d) Multiple samplers operation (Fig. 4). 

e) Cyclic-rate sampling (periodically 
time-varying sampling rate) (Fig. 5). 

f) Skip-sampling, also called time- 
quantitized aperiodic sampling [1] 
(Fig. 6): In this case one or more 
samples of a signal may be periodi- 
cally or generally omitted. The sam- 
ples occur only at integral multiples 
of some minimal period, but do not 
occur all the time. 

g) Slowly varying sampling rate (Fig. 7): 
The change per sample of the period 
is small compared to the period [1]. 

h) Piecewise constant rate sampling [1] 
(Fig. 8). 

i) Finite pulse width sampling (Fig. 9). 

j) Periodically varying sampling rate 
and pulse width (Fig. 10). 

k) General aperiodic sampling of vary- 
ing pulse-width (Fig. 11). 

I) Signal sampling occurring at various 
time gates yo, 1, y2, as shown in Fig. 
12, are sometimes used for the pur- 
pose of better filtering schemes of 
signal and noise [7]. 


b 


wa 


T 


——{eti}— 
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Fig. 1—Periodic sampling with fixed period “T.” 
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Fig. 2—Staggered sampling, 
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Fig. 4—Multiple samplers operation, 


Th 
ree 


ie 


Fig. 5—Cyclic-rate sampling. 
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Fig. 6—Time-quantized sampling, 
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Fig. 7—Slowly varying sampling rate. 
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Fig. 8—Piecewise constant-rate sampling, 
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Fig, 9—Finite pulse-width sampling. 
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Fig. 10—Periodically varying sampling rate 
and pulse width. 
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2) Signal-dependent sampling: In this 
sampling scheme, the operation of the 
sampler is not a priori fixed, but is depend- 
ent on the signals flowing in the system, 
usually the error signal. The basic operation 
of such a sampler in a linear system is a non- 
linear one. This is unlike the first sampling 
pattern which constitutes a linear opera- 
tion, provided the system is linear. The 
signal-dependent schemes can be realized 
in a variety of ways; however, in recent 
literature only two basic schemes are dis- 
cussed. They are enumerated below: 

a) Variable-phase sampling [1]: In this 
scheme, the nth sample time occurs before 
the time (n+4)T, and after (n—4)T, where 
T is an average sampling period and is con- 
stant independent of “n,” i.e., (2—4)T <tp 
<(n+4)T (where f, is the time of nth sam- 
pling pulse). A typical form of ¢ is 
tn=T[n+(tn)], where p(£) is a function of 
the system signals. A schematic diagram of 
such a sampling pattern is shown in Fig. 13. 

b) Variable pulse-width sampling [4]: 
This is also referred to as pulse-width 
modulation and can be accomplished in one 
of the following three forms: 1) lead-type, 


{emi} 


Fig. 12—Train of predetermined pulses of fi(¢) and 
the various gate pulses, 


Fig. 13—Variable-phase sampling. 
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2) lag-type, and 3) lag-delay-integrator 
type. These various types of pulse-width 
modulation are shown in Fig. 14. The opera- 
tion of a magnetic amplifier in a control sys- 
tem is basically of the third type, pulse- 
width modulation. 

c) Zero-signal sampling [6]: In efficient 
transmission of information and for maxi- 
mum bandwidth, it is sometimes necessary 
to sample the time at zero values of the sig- 
nal, as shown in Figs. 15(a) and 15(b). In 
this case, information theory plays an im- 
portant role in the analysis. 

3) Random sampling schemes [1], [6], 
[7]: In this case, the operation of the sam- 
pler occurs at random (Fig. 16), either in 
virtue of “misses” in information or “jitter” 
in a sampling mechanism, or is purposely 
introduced, for reasons of economy in time- 
sharing of a digital computer among several 
processes or for reducing susceptibility to 
jamming or interference. Sampled-data sys- 
tems with random sampling and randomly 
varying parameter are described by differ- 
ence equations with randomly varying co- 
efficients [1]. Stability study of such equa- 
tions is being pursued recently. Further 
study of such systems is being based on the 
statistical properties of the random input 
and sampling [9]. 


DISCUSSION AND USE OF THE VARIOUS 
SAMPLING SCHEMES 


The variety of the sampling schemes 
discussed earlier indicates the extension of 
theory and application from the orthodox 
sampled-data system when originally intro- 
duced. Some of these schemes have practical 
use, either because of inherent operation of 
the sampler, or because of purposeful intro- 
duction of such schemes for reasons of com- 
pensation, economy and optimization pro- 
cedures. For the analysis of linear systems 
with fixed sampling schemes, the z transform 
and the time-varying 3 transform are applica- 
ble, and the problems of stability, response to 
various inputs, and compensation can be eas- 
ily handled with the existing theory. 

Regarding the signal-dependent sampling 
schemes, the linear theory is no longer ade- 
quate except for linearization approxima- 
tion; however, much of the recent advance 
in nonlinear theory of difference equations is 
applicable, including Lyapunov’s second 
method for determining asymptotic stabil- 
ity in the case of pulse-width modulated 
systems [4]. 

Similarly, much activity is being directed 
toward study of discrete systems with ran- 
domly varying parameters and sampling 
schemes, which gives the answer to several 
of the problems connected with the third 
category. 


CONCLUSIONS 


In this short discussion, the aim of the 
writer has been to set forth the problems 
associated with the various sampling 
schemes in the field of sampled-data and 
digital control systems, and to indicate 
specifically the important mathematical 
tools available for dealing with these arising 
situations. From an engineering point of 
view, one should also look into the various 
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Fig. 14—Variable pulse-width sampling. 
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Fig. 15—Signal-dependent sampling scheme (sampling 
time occurring at zeros of signal) [8]. (a) Binary 
signal. (b) Band-limited signal having the speci- 
fied zero crossing. 
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Fig. 16—Random-sampling scheme. 
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approximations which simplify the solution 

of the problem considerably, without any 

significant deviation from the exact solu- 
tion. 

E. I. Jury 

Dept. of Elec. Engrg. 

University of California 

Berkeley, Calif. 
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Notes on the Stability Criterion for 
Linear Discrete Systems* 


It is known that linear time-invariant 
discrete systems can be described by con- 
stant coefficient linear difference equations. 
One of the problems in the analysis of such 
systems is the test for stability. These tests 
involve both graphical procedures such as 
Nyquist locus, Bode diagrams and the root- 
locus, and analytical methods such as 
Schur-Cohn! or Routh-Hurwitz criteria. 


Because of the high-order determinants to be 


evaluated using the present form of the 
Schur-Cohn criterion, many authors have 
used the bilinear transformation which maps 
the inside of the unit circle in the z=e?* plane 
into the left half of the w plane and then 
applied the Routh-Hurwitz criterion. This 


transformation involves algebraic manipu- 


lation which for higher-order systems be- 
comes complicated. 
In this discussion, it is shown that the 


evaluation of the Schur-Cohn! determinants | 


can be simplified considerably, so that the 
manipulations involved in testing for the 
zeros of a polynomial are comparable to 
those using the “transformed” 
Hurwitz criterion, thus avoiding the bilinear 


* Received by the PGAC, October 20, 1960. 

1M. Marden, “The Geometry of the Zeros of a 
Polynomial in a Complex Variable,” American 
Mathematical Society, New York, N. Y.; 1949. 
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transformation. This simplification is based 
on: 1) transforming the original Schur-Cohn 
2k-order matrix A; by a unitary transforma- 
tion to a new matrix whose symmetrical 
structure is utilized to reduce its determi- 
nant, | Ax|, toa product of two determinants 
of matrices of order k; and, 2) exploiting the 
symmetry properties of the k-order matrices 
to reduce the evaluation of the sign of | A;| 
to the identification of certain terms in the 
expansion of one of the product determi- 
nants. Thus, for an n-order polynomial in 2, 
the test for stability involves evaluating de- 
terminants up to order m, a situation gen- 
erally similar to the Routh-Hurwitz cri- 
terion. 


ScHUR-COHN CRITERION 
If for the polynomial 
F(z) = ao + az? + a2? +--+ an, (1) 


all the determinants of the matrices 


Correspondence 


0 0 
ics SRV 

It = 
0 1---0 0 
1 0---0 0 


and Us, the 2k-order unitary matrix 


5 Si °.] 
i, = ‘ 


ee a Fine (Note that U;-! = U;). 
k 


Let Ag=U, "A" Ux, where the super- 
script JT denotes transpose. Then, 


[Ae] = | ae] = | Ae! 


and 


ao 0 0 0 Qn QAn-1 °° On—k+1 
aq ao 0 0 an * An—k+2 
A Gk-1 Ck_2 Ck-3 a 0 O Oe 2) 
Ie = 

an 0 0) -0 & * Op-1 

Gy-1 an 0 SO (0) eet dp-2 

Gn—ki1 Gn-ky2 Gn-eiz::*Gn 0 O +++ a&% 

B12, 2.2° on 


are different from zero, then F(z) has no 
zeros on the circle |z| =1 and yu zeros in this 
circle, u being the number of variations in 
sign in the sequence 1, |Ai|, |A2],---, 
B] Aal. 

For a system of order 7 to be stable, all 
the » zeros of its characteristic nth-order 
equation must lie within the unit circle, 7.e., 
the sequence 1, |A;|, {A2|,---, |A,| must 
have variations in sign. The stability can 
therefore be expressed by the constraints:? 


|d:| <0, odd, 
|A.| >0,  & even. nS) 


For a discrete or a sampled-data system, 
all the coefficients of the characteristic 
equation are real. Hence, the conjugate sign 
on (2) is superfluous. 

As noticed from (2), the highest-order 
determinant |A,| is of order 2”, while the 
characteristic equation is of order . This 
fact was discouraging in using this criterion 

heretofore for higher-order sampled-data 
systems, the easy alternative being to 
transform to the w plane. 


SIMPLIFICATION OF THE STABILITY 
CONSTRAINT EQUATION?® 


Let J, be the k-order identity matrix, 
9;,* the k-order permutation matrix 


2E. I. Jury, “Sampled-Data Control Systems,” 
| John Wiley and Sons, Inc., New York, N. Y.; 1958, 

3B. H. Bharucha, “Analysis of Integral-Square 
Error in Sampled-Data Control Systems,” Electronics 
Res. Lab., University of California, Berkeley, Issue 
No, 206, Series No, 60; 1958. 


e mas ae 
e et it, a3 im 


ad = complex conjugate of az, 


where 
Go GQ Ao+** Ai 
0 a uy On—~2 
XG 5 
ORS0 SRO a 
OR On 0 a 
and 
An—k+1 ° 7 
GQn—ky2°** Gn O 
VG 
eat -0 0 
an -0 0 
Hence, 
Jarl =a) -|5* 5 
Vip Ae 
Xpe+ Ve Ve + Xx 
x | Yi, Xk 
Xt + Vi 0 
se | Vi Xn — Vr 


= |X.+¥.||X-— Vel, 


the product of two k-order determinants 
which is considerably easier to evaluate than 
the direct evaluation of the 2k-order de- 
terminant | A;|. 


THE SYMMETRICAL PROPERTIES OF 
| Xi+ Yi| | X-— Vel 


Now |X:.+Y;| is a homogeneous poly- 
nomial of dimension k in the variables 
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@,°*+, Gm. The polynomial |X,—Y,] is 

identical to the polynomial | X;+ Yx| except 

for a change of sign of those monomial terms 

which have an odd number of elements from 
ae ten 


| X.+ Ye] = Ant Bi, 
GS Y; | = A, — By, 


where A;(B;) is the sum of all monomial 
terms which do not change (do change) sign 
where Y; is replaced by — Y; in | X,+Y;,]. 

To identify A; and B;: 

1) Let all the a,’s in the matrix Y; in 
(9) be denoted by 6;’s; then expand the de- 
terminant | X,+ Y;| in terms of a; and };. 

2) After expansion, examine every term 
which is a product of a;’s and b,’s; if it con- 
tains an even number of b,’s, then it is as- 
signed to A;; otherwise, assign the term to 
By. 

3) After collecting the terms of A, and 
By, replace all the b;’s by the a;’s. 

Hence, 


| Ay |= (AP BY CAg = By Ap = Be 


and for the stability this reduces to 
| Ax| 2|Bz| depending on &. The applica- 
tion of the Schur-Cohn criterion now reduces 
to the evaluation of determinants up to 
order only for nth-order polynomials. The 
transformation to the w plane in order to 
use the Routh-Hurwitz criterion is no longer 
necessary and, in some cases, is more in- 
volved than the procedure outlined above. 
EXAMPLES 


In the following, stability criteria for 
systems up to a fourth-order system are es- 
tablished using the above techniques. 


A. Second-Order System, n=2 
F(z) = ado + aiz + ays”. 
For k=1, X;=a@0, Yr=as. Thus, 
Xi + Vi = a + a, 
| A: | = | Xi+ Y,| [Xi- Va. 


In this case, A; =a0, Bi =a. 
For stability, 


| ai] <0, or Ai? —B,? <0, 
ie, | Ar| < | Bi| or | ao |< [a2]. 
For k=2, 


5 es a ad 
0 do 

Vin a, a2 = by bo 
a 0 bs 0 


Following our procedure for identifying A» 
and Bs, we replaced all the a’s of Y: by 0’s, 


(2s)i= [aero vel, 
Now, 
a+b a+ bz 
| eb Y| +be ao 
= ao? + dob1 — abe —~ bo”. 
Thus, 


As — a3 = bo? = ao” = 22, 


Bo = dob c= aybs = Apa — A1a2. 
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For stability, 


| Ao| > 0, or | As| > | Bal, 
i.e, |do+a2| > ||. 


B. Third-Order System, n=3 


F(z) = ado + aaz + aoz? + a323, 
k =41, X1 = , Yi = 4s, 
Xi + Vi =a + a3 


A, = a, By, = 3. 


For |A:i| <0, [ao] <|as|. 


For k=2, 
ee ao ree | a3 
0 a iran) 
[Xeee Ya] = a+ a2 a+ 43 
a3 ao 


= do? + aod2 — aid; — a3? 


Ag = ayo? — a3”, 


| Az| > 0, | A2| > | Bal, or 
| ac? — a3?| > | doa2 — aia3| . 


By = dode — A103. 


For k=3; k= 
A; 
ao a ae a, a2 fal 
X3 =| a a |, Y3 =)a2 a3 0 i Bz 
0 0 a a3 0 0 
Az = do) + aodyd3 — aody? + 414203 — a2d3" a 
= ayas* Ay 


B; = 309” 4. 41a” + a12a3 — 00102 — Apd203 


— as. 
Thus, for | A3| <0, or the system to be stable, 


| As| < | Bs, 


C. Fourth-Order System, n=4 


The conditions for stability for »=4 are 
given below. 


F(z) = ado + az + doz? + agz* + ast. 
k=1 

A; = %, 
ee 


a> 2 2 
Ay = a = 04, 


By = a4. 


By = A003 — 0104. 
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= dy? + apdeds + a10304 — Aas” — das” 


= A003", 


= ap2a4 + ay2a2 + a12a4 — Apd2d4 — as? 


— 400103. 


= dot — ayaa? — ag2a3? — 2ao?a4? — ar7a4? 


— dy2a4? + ay2d103 + 2a9d22a4 — Apa? 
— 0901244 — 4120204 + 4103042 — Aod2d3” 


+ a9G1203 + 2914304 + 21020304 + as}, 


Bs = Qo%a1 +4 y°a3 = Qpa3° oe a1304 + aya43 


+ a3a43 + apay2a3 — @02d1d2 — A7A203 
— 01042 — 0924104 — 210204 — Ap?a304 
— Apd3042 — A2a304? + a1a37d4 


a 2a9020304 + 200010204. 


For the system to be stable: 


| Aa| (Uh | Ai| < | Bil. 
| Ae| a0! | Ao| > Bae 
bAyt <O;e5 epee <aleeele 
| As| > 0; | A| > | Bal. 
E. I. Jury 


B. H. BHARUCHA 
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Information on Translations of Russian 
Technical Journals 


URING a discussion of the IFAC Moscow Con- 
D gress at the JACC meeting in Boston, it was 

mentioned that the Russians knew more about 
control work in the United States than Americans know 
about similar work in the USSR because they have ex- 
cellent translation facilities which are not available to 
engineers in America. However, Nathan Cohn, repre- 
senting the Instrument Society of America (ISA) an- 
nounced that translations of four leading Russian 
journals have been made by the ISA for the past three 
years to benefit any individual or organization interested 
in Russian developments. Yet in spite of the relatively 
modest cost and the apparent desire to obtain transla- 
tions of Russian papers, there have been very few sub- 
scribers. It was thought that perhaps there has not been 
enough publicity about this service. Because the Rus- 
sians have been leaders in the development of control 
theory, it is important for control engineers to be aware 
of the progress that they are making. For those who are 
interested in obtaining more information about these 
ISA translations, the following ISA announcement is 
quoted: 

“ ... Publication of four Russian technical journals, 
translated into English, will be continued with the 1960 
issues during the coming year by the Instrument So- 
ciety of America, under a grant from the National Sci- 
ence Foundation. Undertaken as a service to American 
science and industry, the ISA ‘Soviet Instrumentation 
and Control Translation Series’ is now in its fourth 
year. It affords U. S. scientists and engineers an excel- 
lent means to be better informed on the latest develop- 
ments in the field of Soviet instrumentation. Included in 
the series are: 

“Automation and Remote Control (Avtomatika 1 Tele- 


mekhantka), considered to be the leading Soviet journal 
in the automatic control field. Published monthly by the 
Institute of Automation and Remote Control of the 
Academy of Science, USSR, it carries approximately 
150 pages per issue of articles on all phases of automatic 
control theories and techniques. 

“Measurement Techniques (Izmeritel’naia Tekhnika), 
approximately 100 pages per issue, published monthly 
by the Committee of Standards, Measures and Measur- 
ing Instruments of the Council of Ministers, USSR. Of 
particular interest to those engaged in the study and ap- 
plication of fundamental measurement. 

“Instruments and Experimental Techniques (Pribory i 
Tekhnika Eksperimenta). Published bimonthly, more 
than 175 pages per issue, by the Academy of Sciences, 
USSR, each issue contains articles relating to the func- 
tion, construction, application and operation of instru- 
ments in various fields of instrumentation. 

“Industrial Laboratory (Zavodskaya Laboratoriya). Pub- 
lished monthly by the Ministry of Light Metals, USSR, 
it contains approximately 125 pages per issue. Articles 
appearing are on instrumentation for analytical chemis- 
try, and physical and mechanical methods of material 
research and testing. 

“The 1960 translations, as well as translations of 
previous years published under ISA’s program, are 
available at low subscription rates ranging from $20 to 
$35 per annual subscription. On a combined order for all 
four journals special rates apply. Libraries of nonprofit 
academic institutions are also offered subscriptions at 
special rates. 

“For subscriptions or information write to Foreign 
Translations Department, Instrument Society of Amer- 
ica, 313 Sixth Avenue, Pittsburgh 22, Pennsylvania.” 
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Announcements 


Since there were no 1960 WESCON sessions on Automatic Control and no part of the 
CONVENTION REcorD devoted to Automatic Control, we will not publish any of the 
WESCON papers in the photo-offset form. Originally, our Group decided to provide a service 
to its membership by supplying, free of charge, the part of the RECORD specified as Auto- 
matic Control. We considered that this was relatively inexpensive for the service it pro- 
vided, and comments were received from readers expressing appreciation for this service. 
However, there have been others who object to the photo-offset from in contrast with our 
regular typeset format. Therefore, since none of the papers were designated as Automatic 
Control papers per se at WESCON, and since they do not appear as a group of papers in the 
CONVENTION REcoRD which could be purchased by any of our members for their control 
library, we will not publish any of the WESCON papers in typeset form. 


PRELIMINARY ANNOUNCEMENT 
INTERNATIONAL SYMPOSIUM ON THE TRANSMISSION AND 
PROCESSING OF INFORMATION 


The Professional Group on Information Theory of the Institute of Radio Engineers, in 
cooperation with the Center of Communication Sciences, Research Laboratory of Elec- 
tronics, Massachusetts Institute of Technology, is planning to hold an International Sym- 
posium on the Transmission and Processing of Information on September 6-8, 1961. This 
Symposium will be held at the Massachusetts Institute of Technology, Cambridge, Mass. 

The purpose of the Symposium will be to provide an outstanding occasion for the presen- 
tation of significant new research contributions, of either a theoretical or an experimental na- 
ture. As in the case of the similar 1954 and 1956 symposia, no tutorial papers will appear; 


‘the program will be planned specifically for active specialists in the field. In order to pro- 


vide opportunity for creative and thorough discussion, the Symposium Transactions will 
be distributed at least two weeks prior to the meetings. 

Submission of papers is hereby invited. In order to carry out the publication plan suc- 
cessfully, the following deadline schedule is necessary: 

Receipt of 500-1000-word Abstracts: Immediately. 
Receipt of full-length Papers: April 1, 1961. 

Authors will be notified of the preliminary acceptance of their Abstracts as soon as 
possible. The final program selection will be made on the basis of the complete Papers, and 
authors notified by May 1. Abstracts and Papers should be submitted to the Chairman of 
the Organizing Committee, R. M. Fano, R.L.E., M.I.T., Cambridge 39, Mass. 

Additional information about the Symposium will be disseminated as plans develop. 


Epwarp M. HOFSTETTER 
Asst. Prof. of Elec. Engrg. 
Res. Lab. of Electronics 
Mass. Inst. Tech. 
Cambridge, Mass. 
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and Eta Kappa Nu, and an associate mem- 
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Michael F. Marx was born on June 24, 
1922, in Johnsonville, N. Y. He received the 
B.A.E. and M.A.E. degrees from Rennselaer 
Polytechnic __ Insti- 
tute, Troy, N. Y., in 
1944 and 1948, re- 
spectively, and the 
A.E. degree from the 
California Institute 
of Technology, Pasa- 
dena, in 1949. He 
received additional 
training at the Gener- 
al Electric Company, 
Schenectady, N. Y., 
where he took courses 
in servomechanisms, 
advanced electronic circuits, and transistor 
circuits. 

From 1943 to 1946, he served with the 
U. S. Navy as a Fighter Director and CIC 
Officer. He instructed at the Rensselaer 
Polytechnic Institute in aerodynamics and 
aircraft structures from 1946 to 1948. Then, 
until 1953, he was a senior aerophysics 
engineer with responsibility for the prelimi- 
nary stability and control work on the 
XB-58 and the stability and control of the 
YB-60 at Convair. Since 1953, he has been a 
flight control development engineer with the 
General Electric Company, Schenectady, 
N. Y. At General Electric, he has been re- 
sponsible for the bomber wiring layout and 
the fighter system gradient and computer- 
flight test correlation of the MX-1137 high- 
performance flight control. He has been 
concerned with the Company’s self-adaptive 
flight development and test program, VTOL 
effort, control techniques and systems for 
space vehicles, and work on structural feed- 
back. Presently, he is heading the advance 
engineering flight control development. 

Mr. Marx is an Associate Fellow of IAS, 
and an associate of Sigma Xi, and is a li- 
censed Professional Engineer in New York. 
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Richard J. McGrath (S’57—-M’60) was 
born in Milwaukee, Wis., on March 25, 
1933. He received the B.S.E.E. degree in 
1958, the M.S.E.E. 
degree in 1959, and 
the Ph.D. degree in 
1960, all from the 
University of Wis- 
consin, Madison. 

He served with 
the U. S. Army from 
1951 through 1953 
and has worked sum- 
mers with General 
Electric and the 
Wisconsin Telephone 
Company. 

From June, 1960 to January, 1961, he 
served as an assistant professor at the Uni- 
versity of Wisconsin, mainly carrying on 
research in the area of adaptive systems. He 
has since joined the Aerospace Corporation, 
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in Los Angeles, Calif. His interests lie in the 
applications of information theory, and 
computing with emphasis on control and 
special problems in data handling. 

Dr. McGrath is a member of Eta Kappa 
Nu, Tau Beta Pi, and Sigma Xi. 


Michael G. Rekoff, Jr. (A’56) was born 
on July 27, 1929, in Galveston, Tex. He re- 
ceived the B.S.E.E. and M.S.E.E. degrees 
from the Agricultural 
and Mechanical Col- 
lege of Texas, Col- 
lege Station, in 1951 
and 1955, respec- 
tively; and the Ph.D. 
degree, also in elec- 
trical engineering, 
from the University 
of Wisconsin, Madi- 
son, in January of 
this year. 

From 1951 to 1953, 
he served in the U. S. 
Army Signal Corps. He then became an in- 
structor and graduate student at the Uni- 
versity of Wisconsin. Presently, he is assist- 
ant professor of electrical engineering at the 
A and M College of Texas. 

Dr. Rekoff is a registered Professional 
Engineer in Wisconsin and Texas and a 
member of the AIEE and Eta Kappa Nu. 
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Vincent C. Rideout (M’44-SM’53-F’60) 
was born in Alberta, Canada, on May 22, 
1914. He received the B.Sc. degree in engi- 
neering physics from 
the University of Al- 
berta, Edmonton, in 
1938, and the M.S. 
degree in electrical 
engineering from the 
California Institute 
of Technology, Pasa- 
dena, in 1939. 

From 1939to1946, 
he was a member of 
the Bell Telephone 
Laboratories Tech- 
nical Staff, working 
on radar and microwave relay research. In 
1946, he joined the staff of the Electrical 
Engineering Department at the University 
of Wisconsin, Madison, as an assistant pro- 
fessor. His main interests, both in research 
and graduate teaching, are now in the fields 
of computing, network theory and random 
process studies. During 1954 and 1955, he 
was in Bangalore, India, where he served as 
a Technical Cooperation Mission Visiting 
Professor of Electrical Communication En- 
gineering at the Indian Institute of Science. 
During 1960 and 1961, he has held a half- 
time appointment in the Mathematics Re- 
search Center of the U. S. Army. He has 
served as consultant to a number of com- 
panies. He now holds the rank of full pro- 
fessor at the University of Wisconsin. 

Prof. Rideout is a member of Sigma Xi, 
Eta Kappa Nu, and Tau Beta Pi. 
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William C. Schultz (M’59) was born on 
July 30, 1927, in Sheboygan, Wis. He re- 
ceived the B.S. degree in electrical engineer- 
ing in 1952, the M.S. 
degree in electrical 
engineering in 1953, 
and the Ph.D. degree 
in 1958, all from the 
University of Wis- 
consin, Madison. His 
thesis topic was the 
general subject of 
control system per- 
formance measures. 

He served in the 
U.S. Navy from 1945 
to 1948, and taught 
in the Navy Electronics Technician Train- 
ing Program from 1946 to 1948. From 1953 
to 1955, he served on the staff of the Analog 
Computing Laboratory at the Allis-Chal- 
mers Manufacturing Company, Milwaukee, 
Wis., where he contributed to the analysis 
and design of electrical and hydraulic auto- 
matic control systems. From 1955 to 1958, 
while working toward the Ph.D. degree at 
the University of Wisconsin, he served as an 
instructor in electrical engineering; he con- 
tinued to serve in that capacity until June, 
1958, when he was appointed assistant pro- 
fessor. Since July, 1958, he has been with the 
Cornell Aeronautical Laboratory, Buffalo, 
N. Y., where he is a principal electronics en- 
gineer. His responsibilities have included 
those of project engineer for a Laboratory 
project concerned with the Naval Tactical 
Data System, which included a wide variety 
of design problems. He has also worked on 
projects on adaptive flight-control systems, 
missile trajectory data processing, and con- 
trol system performance measures. 

For the academic year 1960-1961, he is 
serving as a visiting professor in the School 
of Electrical Engineering, Cornell Univer- 
sity, Ithaca, N. Y. He is teaching courses in 
automatic control theory, and is active in 
research and graduate seminar activities. 

Dr. Schultz is a member of Sigma Xi, 
Tau Beta Pi, and Eta Kappa Nu. 
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Fred. B. Smith, Jr., was born in Oak 
Park, Ill. on January 25, 1930. He received 
the B.A. degree from Kalamazoo College, 
Kalamazoo, Mich., in 
1952, and the M.S. 
degree from the Uni- 
versity of Illinois, 
Urbana, in 1954. 

At the University 
of Illinois, he was a 
research assistant do- 
ing original investiga- 
tions on nuclear de- 
cay schemes. During 
1955, he was employed 
by the Bell Tele- 
phone Laboratories 
working on magnetic core logic studies. Dur- 
ing 1956 and 1957, while with the U. S. 
Army, he was at the Ballistic Research Lab- 
oratories, Aberdeen, Md., where he worked 
on shock tube investigations of weak shock 
formation and effects. Mr. Smith joined 
Minneapolis-Honeywell Regulator Co., Min- 
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neapolis, Minn., in 1957, and contributed to 
their first operational digital computer. For 
the past two years he has been actively 
working in the areas of adaptive and optimal 
control systems. 

Gerald Weiss (SM’59) was born on 
August 3, 1922 in Cologne, Germany, and 
has resided in the United States since 1939. 
He received the 
B.E.E. degree from 
Cooper Union, New 
York, N. Y., in 1943; 
the M.S. degree from 
Harvard University, 
Cambridge, Mass., in 
1948; and the D.E.E. 
degree from the Poly- 
technic Institute of 
Brooklyn, Brooklyn, 
N. Y., in 1959. 

In 1943, he was 
employed by _ the 
Liquidometer Corporation, Long Island 
City, N. Y., on the development of elec- 
tronic fuel gauges. From 1945 to 1947, he 
served briefly in the U. S. Army and after 
his discharge he joined the Arma Corpora- 
tion, Brooklyn, N. Y> At Arma, he was en- 
gaged in the development of electromechan- 
ical computer components, servomotors, 
tachometers, magnetic amplifiers, and in- 
strument servomechanisms. In 1953, he 
joined the W. L. Maxson Corporation, New 
York, N. Y. as a research engineer, partici- 
pating in the design of navigation, bombing, 
and flight path computers; he was sub- 
sequently appointed project manager for 
the ultrasonic flowmeter development pro- 
gram. Since 1958, he has been associated 
with the Polytechnic Institute of Brooklyn, 
where he is now Assistant Professor of elec- 
trical engineering. 

Dr. Weiss is a member of the AIEE, the 
AACC, Tau Beta Piand Sigma Xi. 
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Jack Wing (S’51—A’52—M’57) was born 
in Sacramento, Calif., on November 28, 
1928. He received the B.S.E.E. and M.S.E.E. 
degrees in 1951 and 
1960, respectively, 
from the University 
of California, Berke- 
ley, where he is pres- 
ently studying to- 
ward the Ph.D. de- 
gree in electrical en- 
gineering. 

From1951t01952, 
he worked at Boeing 
Aircraft (Co., Seat- 
tle, Wash., asa mem- 
ber of the B-52 elec- 
trical system group. Later, from 1953 to 1957, 
he was employed by the Bendix Radio Divi- 
sion, Towson, Ind., working on surveillance 
and precision approach radar systems. Dur- 
ing 1958, he worked at Lockheed Missile 
Systems Division, Sunnyvale, Calif., where 
he was concerned with radar reflectivity 
studies. 

Mr. Wing is a member of Tau Beta Pi 
and Eta Kappa Nu. 
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